Jul 06 23:43:28.210440 ip-10-0-135-156 systemd[1]: Starting Kubernetes Kubelet... Jul 06 23:43:28.639157 ip-10-0-135-156 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:43:28.639157 ip-10-0-135-156 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 23:43:28.639157 ip-10-0-135-156 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:43:28.639157 ip-10-0-135-156 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 23:43:28.639157 ip-10-0-135-156 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:43:28.639742 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.639182 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 23:43:28.644658 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644645 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:43:28.644658 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644657 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644662 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644666 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644671 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644674 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644678 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644681 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644684 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644691 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644694 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644697 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644699 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644702 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644705 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644707 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644709 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644712 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644714 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644717 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:43:28.644727 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644719 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644722 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644724 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644726 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644729 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644732 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644735 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644738 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644741 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644743 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644746 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644748 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644751 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644753 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644756 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644758 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644760 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644763 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644767 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:43:28.645175 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644771 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644773 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644776 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644780 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644783 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644785 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644788 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644791 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644794 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644799 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644802 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644805 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644807 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644809 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644811 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644814 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644817 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644819 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644822 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644824 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:43:28.645646 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644827 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644829 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644832 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644834 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644837 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644839 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644842 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644844 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644847 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644849 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644851 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644854 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644856 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644858 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644861 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644863 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644866 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644868 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644870 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644873 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:43:28.646159 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644876 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644879 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644881 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644883 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644886 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644888 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644890 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644893 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644895 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644898 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644901 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644903 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644905 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644908 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644910 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644912 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644915 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644917 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644920 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.644922 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:43:28.646644 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645617 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645624 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645627 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645630 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645633 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645636 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645640 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645643 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645646 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645649 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645652 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645656 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645659 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645662 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645665 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645667 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645670 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645673 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645675 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645678 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:43:28.647114 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645681 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645683 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645686 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645688 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645691 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645694 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645696 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645699 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645701 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645704 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645707 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645710 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645712 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645714 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645717 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645719 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645721 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645724 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645726 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645728 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:43:28.647618 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645731 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645733 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645736 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645738 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645741 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645744 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645746 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645749 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645752 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645754 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645757 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645759 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645761 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645764 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645766 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645768 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645771 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645773 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645777 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:43:28.648087 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645780 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645783 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645786 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645789 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645791 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645794 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645796 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645799 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645801 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645803 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645806 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645808 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645811 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645813 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645815 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645818 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645821 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645823 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645825 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645828 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:43:28.648565 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645831 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645833 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645838 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645842 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645844 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645847 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645850 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645852 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645855 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645857 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645860 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645862 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645864 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645867 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645869 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645872 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645874 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645876 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645879 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.645881 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:43:28.649294 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646736 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646743 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646746 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646749 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646752 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646755 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646758 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646761 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646764 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646768 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646771 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646774 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646777 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646779 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646782 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646784 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646787 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646790 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646792 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646795 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:43:28.649860 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646797 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646801 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646805 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646808 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646810 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646813 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646816 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646818 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646821 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646823 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646826 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646829 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646831 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646833 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646836 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646838 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646841 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646843 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646846 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646848 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:43:28.650364 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646850 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646853 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646856 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646858 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646861 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646864 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646867 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646870 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646875 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646877 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646880 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646882 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646885 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646887 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646889 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646892 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646896 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646899 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646902 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:43:28.650849 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646904 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646907 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646909 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646912 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646914 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646917 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646919 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646922 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646924 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646926 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646929 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646931 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646934 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646936 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646939 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646941 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646944 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646947 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646949 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646952 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:43:28.651353 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646954 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646959 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646962 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646965 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646967 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646969 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646972 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646974 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646976 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646979 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646981 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646985 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646988 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646991 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646993 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646996 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.646998 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647001 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647003 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647006 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:43:28.651931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647067 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647076 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647081 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647086 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647089 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647092 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647097 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647100 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647104 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647109 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647112 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647115 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647118 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647122 2556 flags.go:64] FLAG: --cgroup-root="" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647125 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647128 2556 flags.go:64] FLAG: --client-ca-file="" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647131 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647133 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647138 2556 flags.go:64] FLAG: --cluster-domain="" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647142 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647147 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647151 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647154 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647158 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 23:43:28.652430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647161 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647164 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647167 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647170 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647173 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647175 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647178 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647181 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647185 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647187 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647204 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647207 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647210 2556 flags.go:64] FLAG: --enable-server="true" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647212 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647217 2556 flags.go:64] FLAG: --event-burst="100" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647219 2556 flags.go:64] FLAG: --event-qps="50" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647222 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647227 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647230 2556 flags.go:64] FLAG: --eviction-hard="" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647233 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647236 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647240 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647242 2556 flags.go:64] FLAG: --eviction-soft="" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647245 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647248 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 23:43:28.652987 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647250 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647253 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647255 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647258 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647261 2556 flags.go:64] FLAG: --feature-gates="" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647264 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647267 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647270 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647272 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647276 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647278 2556 flags.go:64] FLAG: --help="false" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647281 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-135-156.ec2.internal" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647284 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647299 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647303 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647306 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647309 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647312 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647315 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647317 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647320 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647323 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647326 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647328 2556 flags.go:64] FLAG: --kube-reserved="" Jul 06 23:43:28.653620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647331 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647334 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647338 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647340 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647344 2556 flags.go:64] FLAG: --lock-file="" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647347 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647349 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647352 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647357 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647360 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647362 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647365 2556 flags.go:64] FLAG: --logging-format="text" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647368 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647371 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647374 2556 flags.go:64] FLAG: --manifest-url="" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647377 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647380 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647383 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647387 2556 flags.go:64] FLAG: --max-pods="110" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647390 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647393 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647396 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647398 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647401 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647404 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 23:43:28.654229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647406 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647413 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647415 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647418 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647421 2556 flags.go:64] FLAG: --pod-cidr="" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647423 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647428 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647430 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647433 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647437 2556 flags.go:64] FLAG: --port="10250" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647439 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647443 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0715781c3eee7b853" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647446 2556 flags.go:64] FLAG: --qos-reserved="" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647448 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647451 2556 flags.go:64] FLAG: --register-node="true" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647454 2556 flags.go:64] FLAG: --register-with-taints="" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647457 2556 flags.go:64] FLAG: --registry-burst="10" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647460 2556 flags.go:64] FLAG: --registry-qps="5" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647463 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647465 2556 flags.go:64] FLAG: --reserved-memory="" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647468 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647472 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647474 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647477 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647480 2556 flags.go:64] FLAG: --runonce="false" Jul 06 23:43:28.654871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647482 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647485 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647488 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647490 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647493 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647495 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647498 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647501 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647504 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647506 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647509 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647511 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647514 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647517 2556 flags.go:64] FLAG: --system-cgroups="" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647519 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647524 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647527 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647535 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647541 2556 flags.go:64] FLAG: --tls-min-version="" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647544 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647546 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647549 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647552 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647555 2556 flags.go:64] FLAG: --v="2" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647562 2556 flags.go:64] FLAG: --version="false" Jul 06 23:43:28.655525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647566 2556 flags.go:64] FLAG: --vmodule="" Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647569 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.647572 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647675 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647679 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647682 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647684 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647687 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647690 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647694 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647699 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647702 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647705 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647709 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647711 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647714 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647716 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647719 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647721 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:43:28.656117 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647724 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647726 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647729 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647732 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647734 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647737 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647741 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647743 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647746 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647748 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647751 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647753 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647756 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647758 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647760 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647763 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647766 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647768 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647770 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647773 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:43:28.656591 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647776 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647778 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647780 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647783 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647785 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647787 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647791 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647794 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647796 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647799 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647801 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647805 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647808 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647811 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647814 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647816 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647819 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647821 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647825 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647828 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:43:28.657066 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647831 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647833 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647835 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647838 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647841 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647843 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647846 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647848 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647850 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647853 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647855 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647857 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647860 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647863 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647865 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647867 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647870 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647872 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647876 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:43:28.657703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647878 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647881 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647883 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647886 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647889 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647891 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647894 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647896 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647899 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647901 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647904 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647907 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647909 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647912 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647915 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647917 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647919 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647922 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647924 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647927 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:43:28.658524 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647929 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:43:28.659377 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647932 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:43:28.659377 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647934 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:43:28.659377 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.647936 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:43:28.659377 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.648532 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:43:28.659647 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.659627 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 23:43:28.659700 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.659648 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 23:43:28.659700 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.659666 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 23:43:28.659700 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.659674 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659752 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659759 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659765 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659769 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659774 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659777 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659782 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659785 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659789 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659793 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659797 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659801 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659805 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659810 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659814 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659818 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659822 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659826 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659830 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:43:28.659840 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659834 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659839 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659843 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659850 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659856 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659860 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659865 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659870 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659875 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659880 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659884 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659889 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659893 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659897 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659901 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659905 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659909 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659913 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659917 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659920 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:43:28.660827 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659924 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659928 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659932 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659936 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659941 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659945 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659949 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659953 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659957 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659961 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659965 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659969 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659973 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659977 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659982 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659986 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659990 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659995 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.659999 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660003 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:43:28.661454 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660007 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660011 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660015 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660019 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660024 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660028 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660032 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660037 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660040 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660044 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660048 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660054 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660059 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660064 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660068 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660072 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660076 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660080 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660085 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:43:28.662176 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660089 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660096 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660101 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660106 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660111 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660116 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660120 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660125 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660129 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660134 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660138 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660142 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660146 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660150 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660154 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660158 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660162 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660166 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660171 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:43:28.663035 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660174 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660179 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.660187 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660393 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660402 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660406 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660411 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660417 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660424 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660428 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660433 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660438 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660442 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660447 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660452 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:43:28.663562 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660458 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660462 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660467 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660471 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660476 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660480 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660484 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660488 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660492 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660496 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660501 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660505 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660509 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660513 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660520 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660525 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660530 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660534 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660539 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660544 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:43:28.664033 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660548 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660553 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660557 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660561 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660566 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660570 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660575 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660579 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660584 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660588 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660593 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660597 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660601 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660605 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660610 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660614 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660619 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660623 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660627 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660631 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:43:28.664549 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660635 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660639 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660643 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660647 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660651 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660655 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660660 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660666 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660671 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660676 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660680 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660684 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660688 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660692 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660696 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660700 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660705 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660709 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:43:28.665031 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660713 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660717 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660721 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660725 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660729 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660733 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660737 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660741 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660747 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660751 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660755 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660759 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660763 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660768 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660772 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660776 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660780 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660785 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660789 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660793 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:43:28.665536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660797 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660801 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660805 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660810 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660814 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660818 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660822 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660826 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:28.660830 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.660836 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.660970 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.663646 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.665158 2556 server.go:1019] "Starting client certificate rotation" Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.665225 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:43:28.666016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.665263 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:43:28.668175 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.668159 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:43:28.670162 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.670141 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:43:28.684862 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.684849 2556 log.go:25] "Validated CRI v1 runtime API" Jul 06 23:43:28.688404 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.688389 2556 log.go:25] "Validated CRI v1 image API" Jul 06 23:43:28.689166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.689153 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 23:43:28.691930 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.691899 2556 fs.go:135] Filesystem UUIDs: map[1a411fe7-df1f-429b-822c-ad0b3eff68da:/dev/nvme0n1p4 1f7a8cfd-824d-4f35-a6f3-2d8ce1e2b2f3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 06 23:43:28.691988 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.691927 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 23:43:28.693533 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.693507 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:43:28.696916 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.696817 2556 manager.go:216] Machine: {Timestamp:2026-07-06 23:43:28.695476637 +0000 UTC m=+0.360651667 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100220 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e926cd047881ca1523fe53f02927 SystemUUID:ec24e926-cd04-7881-ca15-23fe53f02927 BootID:4f224214-d92e-4733-8a5d-051ba182342e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:ad:21:e5:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:ad:21:e5:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:d0:89:33:42:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 23:43:28.696916 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.696914 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 23:43:28.697017 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.696977 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 23:43:28.700093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.700069 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 23:43:28.700234 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.700095 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-156.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 23:43:28.701630 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.701620 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 23:43:28.701668 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.701633 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 23:43:28.701668 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.701641 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:43:28.703218 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.703207 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:43:28.704557 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.704547 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 23:43:28.707486 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707475 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:43:28.707587 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707578 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 23:43:28.707617 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707606 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 06 23:43:28.707617 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707615 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 23:43:28.707671 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707625 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 23:43:28.707671 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707633 2556 kubelet.go:398] "Adding apiserver pod source" Jul 06 23:43:28.707671 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707641 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 23:43:28.707931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707918 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:43:28.707977 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.707943 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:43:28.710004 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.709988 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 23:43:28.711829 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.711815 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 23:43:28.711872 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.711846 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 23:43:28.713226 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713214 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 23:43:28.713260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713232 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 23:43:28.713260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713239 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 23:43:28.713260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713244 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 23:43:28.713260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713253 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 23:43:28.713260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713258 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 23:43:28.713384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713266 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 23:43:28.713384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713271 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 23:43:28.713384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713277 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 23:43:28.713384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713283 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 23:43:28.713384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713297 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 23:43:28.713384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.713302 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 23:43:28.714077 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.714068 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 23:43:28.714077 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.714078 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 23:43:28.715766 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.715752 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p4k88" Jul 06 23:43:28.717317 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.717292 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-156.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 23:43:28.717317 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.717306 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 23:43:28.717451 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.717322 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 23:43:28.717571 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.717559 2556 server.go:1268] "Started kubelet" Jul 06 23:43:28.717703 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.717639 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 23:43:28.717789 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.717676 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 23:43:28.717789 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.717718 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 23:43:28.718413 ip-10-0-135-156 systemd[1]: Started Kubernetes Kubelet. Jul 06 23:43:28.719040 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.718957 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 06 23:43:28.719491 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.719411 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 23:43:28.723016 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.722998 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 23:43:28.723470 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.723453 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p4k88" Jul 06 23:43:28.723470 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.722055 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-156.ec2.internal.18bfd7f145a4f2ec default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-156.ec2.internal,UID:ip-10-0-135-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-156.ec2.internal,},FirstTimestamp:2026-07-06 23:43:28.717533932 +0000 UTC m=+0.382708962,LastTimestamp:2026-07-06 23:43:28.717533932 +0000 UTC m=+0.382708962,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-156.ec2.internal,}" Jul 06 23:43:28.724480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.724460 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 23:43:28.724480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.724469 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 23:43:28.724620 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.724567 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:28.725365 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.725269 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 23:43:28.725465 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.725368 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 23:43:28.725465 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.725260 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 23:43:28.725768 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.725735 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 06 23:43:28.725768 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.725752 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 06 23:43:28.726399 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.726385 2556 factory.go:55] Registering systemd factory Jul 06 23:43:28.726399 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.726400 2556 factory.go:223] Registration of the systemd container factory successfully Jul 06 23:43:28.726596 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.726582 2556 factory.go:153] Registering CRI-O factory Jul 06 23:43:28.726643 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.726607 2556 factory.go:223] Registration of the crio container factory successfully Jul 06 23:43:28.726686 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.726656 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 23:43:28.726686 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.726679 2556 factory.go:103] Registering Raw factory Jul 06 23:43:28.726786 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.726696 2556 manager.go:1196] Started watching for new ooms in manager Jul 06 23:43:28.727087 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.727073 2556 manager.go:349] Starting recovery of all containers Jul 06 23:43:28.737976 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.737960 2556 manager.go:354] Recovery completed Jul 06 23:43:28.738437 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.738418 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:43:28.741086 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.741063 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-156.ec2.internal\" not found" node="ip-10-0-135-156.ec2.internal" Jul 06 23:43:28.742282 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.742270 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:43:28.744003 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.743990 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:43:28.744055 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.744017 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:43:28.744055 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.744029 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:43:28.744518 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.744505 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 23:43:28.744518 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.744517 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 23:43:28.744617 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.744531 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:43:28.744617 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.744510 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:43:28.745282 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.745265 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:43:28.745335 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.745292 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:43:28.745335 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.745302 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:43:28.745653 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.745642 2556 policy_none.go:49] "None policy: Start" Jul 06 23:43:28.745692 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.745657 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 23:43:28.745692 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.745667 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 23:43:28.746872 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.746859 2556 policy_none.go:47] "Start" Jul 06 23:43:28.776767 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.776752 2556 manager.go:337] "Starting Device Plugin manager" Jul 06 23:43:28.776837 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.776778 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 23:43:28.776837 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.776787 2556 server.go:87] "Starting device plugin registration server" Jul 06 23:43:28.776989 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.776972 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 23:43:28.777071 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.776991 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 23:43:28.777071 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.777062 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 23:43:28.777235 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.777130 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 23:43:28.777235 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.777139 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 23:43:28.777625 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.777606 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 23:43:28.777684 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.777649 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:28.855765 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.855736 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 23:43:28.857056 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.857041 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 23:43:28.857112 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.857078 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 23:43:28.857112 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.857098 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 23:43:28.857208 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.857136 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 23:43:28.859806 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.859783 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:43:28.877103 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.877090 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:43:28.877798 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.877784 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:43:28.877854 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.877813 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:43:28.877854 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.877825 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:43:28.877854 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.877844 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-156.ec2.internal" Jul 06 23:43:28.884282 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.884268 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-156.ec2.internal" Jul 06 23:43:28.884362 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.884292 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-156.ec2.internal\": node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:28.901997 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.901982 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:28.958080 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.958061 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal"] Jul 06 23:43:28.958131 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.958113 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:43:28.959499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.959481 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:43:28.959564 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.959508 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:43:28.959564 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.959518 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:43:28.960805 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.960793 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:43:28.960916 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.960901 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" Jul 06 23:43:28.960955 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.960930 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:43:28.961443 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.961420 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:43:28.961443 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.961429 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:43:28.961555 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.961452 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:43:28.961555 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.961461 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:43:28.961555 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.961474 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:43:28.961555 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.961464 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:43:28.962948 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.962935 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:28.963020 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.962959 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:43:28.963607 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.963588 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:43:28.963688 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.963613 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:43:28.963688 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:28.963624 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:43:28.980791 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.980767 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-156.ec2.internal\" not found" node="ip-10-0-135-156.ec2.internal" Jul 06 23:43:28.984729 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:28.984712 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-156.ec2.internal\" not found" node="ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.002437 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.002422 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.027302 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.027280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61edf0106ebb2b4c26e7cc80b4ce80d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal\" (UID: \"61edf0106ebb2b4c26e7cc80b4ce80d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.027347 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.027308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92840009ecdd9bea75a49d7eefaa1ddc-config\") pod \"kube-apiserver-proxy-ip-10-0-135-156.ec2.internal\" (UID: \"92840009ecdd9bea75a49d7eefaa1ddc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.027347 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.027324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61edf0106ebb2b4c26e7cc80b4ce80d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal\" (UID: \"61edf0106ebb2b4c26e7cc80b4ce80d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.103251 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.103218 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.127485 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.127464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92840009ecdd9bea75a49d7eefaa1ddc-config\") pod \"kube-apiserver-proxy-ip-10-0-135-156.ec2.internal\" (UID: \"92840009ecdd9bea75a49d7eefaa1ddc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.127560 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.127490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61edf0106ebb2b4c26e7cc80b4ce80d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal\" (UID: \"61edf0106ebb2b4c26e7cc80b4ce80d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.127560 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.127508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61edf0106ebb2b4c26e7cc80b4ce80d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal\" (UID: \"61edf0106ebb2b4c26e7cc80b4ce80d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.127560 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.127548 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61edf0106ebb2b4c26e7cc80b4ce80d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal\" (UID: \"61edf0106ebb2b4c26e7cc80b4ce80d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.127687 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.127592 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61edf0106ebb2b4c26e7cc80b4ce80d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal\" (UID: \"61edf0106ebb2b4c26e7cc80b4ce80d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.127687 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.127594 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92840009ecdd9bea75a49d7eefaa1ddc-config\") pod \"kube-apiserver-proxy-ip-10-0-135-156.ec2.internal\" (UID: \"92840009ecdd9bea75a49d7eefaa1ddc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.204130 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.204071 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.284710 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.284691 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.288867 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.288693 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:29.305028 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.305007 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.405574 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.405549 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.506074 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.506023 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.606582 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.606559 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.665054 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.665025 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 23:43:29.665554 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.665187 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:43:29.665554 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.665219 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:43:29.707306 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.707283 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.728297 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.728254 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:38:29 +0000 UTC" deadline="2028-04-04 23:22:20.350208372 +0000 UTC" Jul 06 23:43:29.728297 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.728294 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15311h38m50.621917488s" Jul 06 23:43:29.802075 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:29.802043 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92840009ecdd9bea75a49d7eefaa1ddc.slice/crio-2c3e6b442939849b9ee5b05cfe96c5cb3788f752b88d35df7a906f7969018be5 WatchSource:0}: Error finding container 2c3e6b442939849b9ee5b05cfe96c5cb3788f752b88d35df7a906f7969018be5: Status 404 returned error can't find the container with id 2c3e6b442939849b9ee5b05cfe96c5cb3788f752b88d35df7a906f7969018be5 Jul 06 23:43:29.802314 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:29.802299 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61edf0106ebb2b4c26e7cc80b4ce80d8.slice/crio-1bbe06bf4541a838f0940b0f9bce52a5898780d1a733bcd88f68fb423114b8f9 WatchSource:0}: Error finding container 1bbe06bf4541a838f0940b0f9bce52a5898780d1a733bcd88f68fb423114b8f9: Status 404 returned error can't find the container with id 1bbe06bf4541a838f0940b0f9bce52a5898780d1a733bcd88f68fb423114b8f9 Jul 06 23:43:29.807052 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.807036 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:43:29.807369 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.807349 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.860902 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.860860 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" event={"ID":"92840009ecdd9bea75a49d7eefaa1ddc","Type":"ContainerStarted","Data":"2c3e6b442939849b9ee5b05cfe96c5cb3788f752b88d35df7a906f7969018be5"} Jul 06 23:43:29.861945 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.861915 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" event={"ID":"61edf0106ebb2b4c26e7cc80b4ce80d8","Type":"ContainerStarted","Data":"1bbe06bf4541a838f0940b0f9bce52a5898780d1a733bcd88f68fb423114b8f9"} Jul 06 23:43:29.910256 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:29.910219 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:29.954968 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:29.954944 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:43:30.010337 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.010311 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:30.115782 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.115721 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:30.216818 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.216788 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-156.ec2.internal\" not found" Jul 06 23:43:30.240342 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.240320 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:43:30.325618 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.325417 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" Jul 06 23:43:30.335998 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.335973 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:43:30.337444 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.337417 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" Jul 06 23:43:30.347175 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.347156 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:43:30.709381 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.709350 2556 apiserver.go:52] "Watching apiserver" Jul 06 23:43:30.717699 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.717675 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 23:43:30.718251 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.718205 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dt5dc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal","openshift-multus/multus-additional-cni-plugins-d4dzf","openshift-image-registry/node-ca-x7v8t","openshift-multus/multus-f7279","openshift-multus/network-metrics-daemon-4gcnp","openshift-network-diagnostics/network-check-target-kgtsk","openshift-network-operator/iptables-alerter-7jqbh","openshift-ovn-kubernetes/ovnkube-node-45k2f","kube-system/global-pull-secret-syncer-6dxdx","kube-system/konnectivity-agent-w66wc","kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv","openshift-cluster-node-tuning-operator/tuned-87cqm"] Jul 06 23:43:30.720120 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.720010 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:30.720213 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.720113 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:30.721336 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.721314 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.722822 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.722801 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.724109 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.724085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k47kl\"" Jul 06 23:43:30.724889 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.724582 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 23:43:30.724889 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.724601 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 23:43:30.724889 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.724758 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 23:43:30.725195 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.725175 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 23:43:30.725523 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.725496 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sv9ks\"" Jul 06 23:43:30.725614 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.725535 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 23:43:30.725788 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.725760 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 23:43:30.725843 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.725503 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 23:43:30.725974 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.725957 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 23:43:30.726024 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.725994 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 23:43:30.726146 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.726125 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.727389 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.727369 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f7279" Jul 06 23:43:30.730300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.729601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:30.730300 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.729684 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:30.730300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.730066 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 23:43:30.730300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.730093 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 23:43:30.730571 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.730389 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xgb5z\"" Jul 06 23:43:30.730571 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.730454 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 23:43:30.730676 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.730640 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 23:43:30.732140 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.732121 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p8dfq\"" Jul 06 23:43:30.732662 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.732641 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.735076 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-etc-kubernetes\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735149 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-kubelet\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735149 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735120 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-hostroot\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735269 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-sys-fs\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.735269 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnd77\" (UniqueName: \"kubernetes.io/projected/b60a980f-e9bb-4213-bf7c-1eea2faab280-kube-api-access-hnd77\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.735269 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735202 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-cni-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735269 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-socket-dir-parent\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-conf-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-device-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735307 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-system-cni-dir\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-cnibin\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-cni-binary-copy\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-daemon-config\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlmmj\" (UniqueName: \"kubernetes.io/projected/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-kube-api-access-hlmmj\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-os-release\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02ff99e6-eed4-4326-8a58-dcec0181dbdf-serviceca\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735593 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735605 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-registration-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02ff99e6-eed4-4326-8a58-dcec0181dbdf-host\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-os-release\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-k8s-cni-cncf-io\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735728 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-cni-bin\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735751 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6qttn\"" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735765 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-socket-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-etc-selinux\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-system-cni-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735892 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.735901 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-cnibin\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klfsx\" (UniqueName: \"kubernetes.io/projected/2261ca51-ce32-4780-b702-58fec63fc300-kube-api-access-klfsx\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdx6\" (UniqueName: \"kubernetes.io/projected/02ff99e6-eed4-4326-8a58-dcec0181dbdf-kube-api-access-nkdx6\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.735989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-cni-multus\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.736021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-multus-certs\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.736071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.736108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-netns\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.736521 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 23:43:30.736751 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.736723 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 23:43:30.737192 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.736946 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 23:43:30.737558 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.737540 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.738376 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qpv7j\"" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.738594 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.738829 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.739773 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.740085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jgwlf\"" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.740465 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.740739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.740804 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:30.741155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.740820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:30.741716 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.741191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.743144 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.742994 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:43:30.743354 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.743320 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 23:43:30.743435 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.743387 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 23:43:30.743435 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.743422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xz4w7\"" Jul 06 23:43:30.743856 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.743823 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:43:30.744193 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.744171 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 23:43:30.744293 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.744211 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kwfhg\"" Jul 06 23:43:30.744293 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.744265 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 23:43:30.748371 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.748349 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:43:30.768760 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.768739 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6skvj" Jul 06 23:43:30.777230 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.777205 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6skvj" Jul 06 23:43:30.827511 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.827347 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 23:43:30.836339 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-env-overrides\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.836460 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-system-cni-dir\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.836460 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-cnibin\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.836460 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.836460 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836448 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-cnibin\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836458 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-system-cni-dir\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-cni-binary-copy\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836538 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlmmj\" (UniqueName: \"kubernetes.io/projected/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-kube-api-access-hlmmj\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysconfig\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-var-lib-kubelet\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-host\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-run-netns\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.836704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836690 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-os-release\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-k8s-cni-cncf-io\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-etc-selinux\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-system-cni-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-cnibin\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klfsx\" (UniqueName: \"kubernetes.io/projected/2261ca51-ce32-4780-b702-58fec63fc300-kube-api-access-klfsx\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysctl-conf\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836717 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf87aa93-c0c4-49ad-abed-995d38a63e6b-konnectivity-ca\") pod \"konnectivity-agent-w66wc\" (UID: \"cf87aa93-c0c4-49ad-abed-995d38a63e6b\") " pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-cnibin\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836971 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-k8s-cni-cncf-io\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.836994 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837019 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovnkube-script-lib\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837057 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-system-cni-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837023 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-os-release\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837093 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdx6\" (UniqueName: \"kubernetes.io/projected/02ff99e6-eed4-4326-8a58-dcec0181dbdf-kube-api-access-nkdx6\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-multus-certs\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837130 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-etc-selinux\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-cni-binary-copy\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-run\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4h2\" (UniqueName: \"kubernetes.io/projected/34530934-f88d-47d2-90cd-1330d7844f5c-kube-api-access-4t4h2\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovnkube-config\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837335 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-netns\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-multus-certs\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34530934-f88d-47d2-90cd-1330d7844f5c-iptables-alerter-script\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-run-netns\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34530934-f88d-47d2-90cd-1330d7844f5c-host-slash\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-systemd-units\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837517 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-kubelet\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-kubernetes\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837575 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-kubelet\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837606 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj5b9\" (UniqueName: \"kubernetes.io/projected/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-kube-api-access-lj5b9\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:30.837726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-node-log\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnd77\" (UniqueName: \"kubernetes.io/projected/b60a980f-e9bb-4213-bf7c-1eea2faab280-kube-api-access-hnd77\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-cni-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837720 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-socket-dir-parent\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-device-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-sys\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-ovn\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837822 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-daemon-config\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-registration-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837917 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-device-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837922 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837959 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-cni-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.837991 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-registration-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838035 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-socket-dir-parent\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-systemd\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.838510 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fce18fdc-bd9b-4997-8937-d927ec259001-kubelet-config\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-run-ovn-kubernetes\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-cni-netd\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838158 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-os-release\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838174 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02ff99e6-eed4-4326-8a58-dcec0181dbdf-serviceca\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838235 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02ff99e6-eed4-4326-8a58-dcec0181dbdf-host\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-cni-bin\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838307 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-socket-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-systemd\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838330 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-daemon-config\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-etc-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838364 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb22p\" (UniqueName: \"kubernetes.io/projected/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-kube-api-access-jb22p\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838430 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b60a980f-e9bb-4213-bf7c-1eea2faab280-os-release\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysctl-d\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-lib-modules\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-var-lib-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839183 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-cni-multus\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff1387c-c93b-4550-b362-40131faadbb7-hosts-file\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838553 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff1387c-c93b-4550-b362-40131faadbb7-tmp-dir\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnb2r\" (UniqueName: \"kubernetes.io/projected/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-kube-api-access-rnb2r\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf87aa93-c0c4-49ad-abed-995d38a63e6b-agent-certs\") pod \"konnectivity-agent-w66wc\" (UID: \"cf87aa93-c0c4-49ad-abed-995d38a63e6b\") " pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-log-socket\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838664 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-cni-bin\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838709 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-etc-kubernetes\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnpr4\" (UniqueName: \"kubernetes.io/projected/5ff1387c-c93b-4550-b362-40131faadbb7-kube-api-access-hnpr4\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-modprobe-d\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-tuned\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-tmp\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838850 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fce18fdc-bd9b-4997-8937-d927ec259001-dbus\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838866 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovn-node-metrics-cert\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.839934 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-hostroot\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838911 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-sys-fs\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-kubelet\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-slash\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-conf-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.838997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839054 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-cni-multus\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839084 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b60a980f-e9bb-4213-bf7c-1eea2faab280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-etc-kubernetes\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839158 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-hostroot\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-sys-fs\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839234 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-multus-conf-dir\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839302 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02ff99e6-eed4-4326-8a58-dcec0181dbdf-host\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839329 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-host-var-lib-cni-bin\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839406 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2261ca51-ce32-4780-b702-58fec63fc300-socket-dir\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.840665 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.839416 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02ff99e6-eed4-4326-8a58-dcec0181dbdf-serviceca\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.853510 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.853482 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:43:30.853615 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.853518 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:43:30.853615 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.853535 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pfwxd for pod openshift-network-diagnostics/network-check-target-kgtsk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:30.853615 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.853603 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd podName:bfada76e-ae0e-47fa-b3e8-cc16d300476c nodeName:}" failed. No retries permitted until 2026-07-06 23:43:31.353582539 +0000 UTC m=+3.018757557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pfwxd" (UniqueName: "kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd") pod "network-check-target-kgtsk" (UID: "bfada76e-ae0e-47fa-b3e8-cc16d300476c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:30.853800 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.853707 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 23:43:30.857957 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.857925 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdx6\" (UniqueName: \"kubernetes.io/projected/02ff99e6-eed4-4326-8a58-dcec0181dbdf-kube-api-access-nkdx6\") pod \"node-ca-x7v8t\" (UID: \"02ff99e6-eed4-4326-8a58-dcec0181dbdf\") " pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:30.858069 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.857941 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlmmj\" (UniqueName: \"kubernetes.io/projected/a3a5678c-ebba-4ced-b5b7-8355497bc2b6-kube-api-access-hlmmj\") pod \"multus-f7279\" (UID: \"a3a5678c-ebba-4ced-b5b7-8355497bc2b6\") " pod="openshift-multus/multus-f7279" Jul 06 23:43:30.858997 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.858971 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnd77\" (UniqueName: \"kubernetes.io/projected/b60a980f-e9bb-4213-bf7c-1eea2faab280-kube-api-access-hnd77\") pod \"multus-additional-cni-plugins-d4dzf\" (UID: \"b60a980f-e9bb-4213-bf7c-1eea2faab280\") " pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:30.859260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.859228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klfsx\" (UniqueName: \"kubernetes.io/projected/2261ca51-ce32-4780-b702-58fec63fc300-kube-api-access-klfsx\") pod \"aws-ebs-csi-driver-node-m95gv\" (UID: \"2261ca51-ce32-4780-b702-58fec63fc300\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:30.939247 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysconfig\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939247 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939238 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-var-lib-kubelet\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-host\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939305 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-run-netns\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939312 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysconfig\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysctl-conf\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939372 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-var-lib-kubelet\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939381 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf87aa93-c0c4-49ad-abed-995d38a63e6b-konnectivity-ca\") pod \"konnectivity-agent-w66wc\" (UID: \"cf87aa93-c0c4-49ad-abed-995d38a63e6b\") " pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939382 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-host\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovnkube-script-lib\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939373 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-run-netns\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939471 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-run\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939497 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4h2\" (UniqueName: \"kubernetes.io/projected/34530934-f88d-47d2-90cd-1330d7844f5c-kube-api-access-4t4h2\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.939515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939514 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovnkube-config\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939549 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-run\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34530934-f88d-47d2-90cd-1330d7844f5c-iptables-alerter-script\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34530934-f88d-47d2-90cd-1330d7844f5c-host-slash\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-systemd-units\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939638 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-kubernetes\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj5b9\" (UniqueName: \"kubernetes.io/projected/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-kube-api-access-lj5b9\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-node-log\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-sys\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-ovn\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939774 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-systemd\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fce18fdc-bd9b-4997-8937-d927ec259001-kubelet-config\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-run-ovn-kubernetes\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-cni-netd\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-systemd\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.939931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939881 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-etc-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939898 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb22p\" (UniqueName: \"kubernetes.io/projected/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-kube-api-access-jb22p\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939916 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysctl-d\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939925 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf87aa93-c0c4-49ad-abed-995d38a63e6b-konnectivity-ca\") pod \"konnectivity-agent-w66wc\" (UID: \"cf87aa93-c0c4-49ad-abed-995d38a63e6b\") " pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939932 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-lib-modules\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-var-lib-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939967 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff1387c-c93b-4550-b362-40131faadbb7-hosts-file\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff1387c-c93b-4550-b362-40131faadbb7-tmp-dir\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnb2r\" (UniqueName: \"kubernetes.io/projected/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-kube-api-access-rnb2r\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf87aa93-c0c4-49ad-abed-995d38a63e6b-agent-certs\") pod \"konnectivity-agent-w66wc\" (UID: \"cf87aa93-c0c4-49ad-abed-995d38a63e6b\") " pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940038 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-log-socket\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-cni-bin\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovnkube-config\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940125 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-etc-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940131 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34530934-f88d-47d2-90cd-1330d7844f5c-host-slash\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-systemd\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.939498 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysctl-conf\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.940549 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnpr4\" (UniqueName: \"kubernetes.io/projected/5ff1387c-c93b-4550-b362-40131faadbb7-kube-api-access-hnpr4\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovnkube-script-lib\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940201 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940206 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-run-ovn\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-systemd-units\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940310 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-kubernetes\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff1387c-c93b-4550-b362-40131faadbb7-tmp-dir\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940466 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-node-log\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940524 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-sys\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940577 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-cni-bin\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940658 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-log-socket\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.940665 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940686 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-sysctl-d\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940719 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-var-lib-openvswitch\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940743 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff1387c-c93b-4550-b362-40131faadbb7-hosts-file\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940799 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-run-ovn-kubernetes\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-lib-modules\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34530934-f88d-47d2-90cd-1330d7844f5c-iptables-alerter-script\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.941166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940860 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-systemd\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-modprobe-d\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940888 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fce18fdc-bd9b-4997-8937-d927ec259001-kubelet-config\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-tuned\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940912 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-cni-netd\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-tmp\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.940969 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs podName:97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f nodeName:}" failed. No retries permitted until 2026-07-06 23:43:31.440950508 +0000 UTC m=+3.106125530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs") pod "network-metrics-daemon-4gcnp" (UID: "97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.940979 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-modprobe-d\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fce18fdc-bd9b-4997-8937-d927ec259001-dbus\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941028 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovn-node-metrics-cert\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-kubelet\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941087 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-slash\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941142 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fce18fdc-bd9b-4997-8937-d927ec259001-dbus\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-env-overrides\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941232 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-kubelet\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941339 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-host-slash\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.942254 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.941424 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:30.944017 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:30.941485 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret podName:fce18fdc-bd9b-4997-8937-d927ec259001 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:31.441467373 +0000 UTC m=+3.106642406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret") pod "global-pull-secret-syncer-6dxdx" (UID: "fce18fdc-bd9b-4997-8937-d927ec259001") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:30.944017 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.941499 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-env-overrides\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.944017 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.943524 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf87aa93-c0c4-49ad-abed-995d38a63e6b-agent-certs\") pod \"konnectivity-agent-w66wc\" (UID: \"cf87aa93-c0c4-49ad-abed-995d38a63e6b\") " pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:30.944017 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.943907 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-etc-tuned\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.944017 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.943950 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-tmp\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.944017 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.943963 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-ovn-node-metrics-cert\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.952219 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.952192 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4h2\" (UniqueName: \"kubernetes.io/projected/34530934-f88d-47d2-90cd-1330d7844f5c-kube-api-access-4t4h2\") pod \"iptables-alerter-7jqbh\" (UID: \"34530934-f88d-47d2-90cd-1330d7844f5c\") " pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:30.952636 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.952617 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj5b9\" (UniqueName: \"kubernetes.io/projected/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-kube-api-access-lj5b9\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:30.953245 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.953221 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb22p\" (UniqueName: \"kubernetes.io/projected/83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3-kube-api-access-jb22p\") pod \"ovnkube-node-45k2f\" (UID: \"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:30.953635 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.953608 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnpr4\" (UniqueName: \"kubernetes.io/projected/5ff1387c-c93b-4550-b362-40131faadbb7-kube-api-access-hnpr4\") pod \"node-resolver-dt5dc\" (UID: \"5ff1387c-c93b-4550-b362-40131faadbb7\") " pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:30.954382 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.954365 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnb2r\" (UniqueName: \"kubernetes.io/projected/a641feac-98bc-4ddd-8d99-87b2a68e1b8d-kube-api-access-rnb2r\") pod \"tuned-87cqm\" (UID: \"a641feac-98bc-4ddd-8d99-87b2a68e1b8d\") " pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:30.986156 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:30.986101 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:43:31.039796 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.039773 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" Jul 06 23:43:31.048041 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.048023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" Jul 06 23:43:31.057827 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.057805 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x7v8t" Jul 06 23:43:31.063800 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.063780 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f7279" Jul 06 23:43:31.071568 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.071548 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:31.079578 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.079555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dt5dc" Jul 06 23:43:31.089383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.089365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87cqm" Jul 06 23:43:31.096085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.096066 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:31.103904 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.103884 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jqbh" Jul 06 23:43:31.444447 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.444404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:31.444447 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.444452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:31.444691 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.444480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:31.444691 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444553 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:31.444691 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444593 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:43:31.444691 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444610 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:43:31.444691 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444623 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pfwxd for pod openshift-network-diagnostics/network-check-target-kgtsk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:31.444691 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444631 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs podName:97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f nodeName:}" failed. No retries permitted until 2026-07-06 23:43:32.444606441 +0000 UTC m=+4.109781459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs") pod "network-metrics-daemon-4gcnp" (UID: "97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:31.444691 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444665 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd podName:bfada76e-ae0e-47fa-b3e8-cc16d300476c nodeName:}" failed. No retries permitted until 2026-07-06 23:43:32.444650469 +0000 UTC m=+4.109825488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfwxd" (UniqueName: "kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd") pod "network-check-target-kgtsk" (UID: "bfada76e-ae0e-47fa-b3e8-cc16d300476c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:31.445046 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444740 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:31.445046 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.444816 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret podName:fce18fdc-bd9b-4997-8937-d927ec259001 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:32.444796122 +0000 UTC m=+4.109971153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret") pod "global-pull-secret-syncer-6dxdx" (UID: "fce18fdc-bd9b-4997-8937-d927ec259001") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:31.779576 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.779487 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:38:31 +0000 UTC" deadline="2028-02-14 05:31:17.129024312 +0000 UTC" Jul 06 23:43:31.779576 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.779573 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14093h47m45.34945678s" Jul 06 23:43:31.857483 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:31.857446 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:31.857658 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:31.857568 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:31.944732 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.944701 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60a980f_e9bb_4213_bf7c_1eea2faab280.slice/crio-087676da76780ea1c34c9b0a3040aa2a2993a7852d6a8d16d8c0d241a8774973 WatchSource:0}: Error finding container 087676da76780ea1c34c9b0a3040aa2a2993a7852d6a8d16d8c0d241a8774973: Status 404 returned error can't find the container with id 087676da76780ea1c34c9b0a3040aa2a2993a7852d6a8d16d8c0d241a8774973 Jul 06 23:43:31.946427 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.946373 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff1387c_c93b_4550_b362_40131faadbb7.slice/crio-1b7c0e95df9f57880e35edee95b97fa621c935da339a480a9cf361f410da00bd WatchSource:0}: Error finding container 1b7c0e95df9f57880e35edee95b97fa621c935da339a480a9cf361f410da00bd: Status 404 returned error can't find the container with id 1b7c0e95df9f57880e35edee95b97fa621c935da339a480a9cf361f410da00bd Jul 06 23:43:31.948034 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.947998 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f9cf67_e98c_43ea_a3f6_c6b56fea1cd3.slice/crio-e1b8f18c97ae7bdb6f0818cf34af1faa407dcabb87bd17fe8cccde511528df50 WatchSource:0}: Error finding container e1b8f18c97ae7bdb6f0818cf34af1faa407dcabb87bd17fe8cccde511528df50: Status 404 returned error can't find the container with id e1b8f18c97ae7bdb6f0818cf34af1faa407dcabb87bd17fe8cccde511528df50 Jul 06 23:43:31.954361 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.954337 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf87aa93_c0c4_49ad_abed_995d38a63e6b.slice/crio-30ad504a15c5914915a60579f60a6a0832556673017d27dc2cd6a43a0c9fe88d WatchSource:0}: Error finding container 30ad504a15c5914915a60579f60a6a0832556673017d27dc2cd6a43a0c9fe88d: Status 404 returned error can't find the container with id 30ad504a15c5914915a60579f60a6a0832556673017d27dc2cd6a43a0c9fe88d Jul 06 23:43:31.957633 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.957607 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2261ca51_ce32_4780_b702_58fec63fc300.slice/crio-6cb4efc74785b6576220bf0ed451af45f0347550d00989d7cbb60723ed67aa55 WatchSource:0}: Error finding container 6cb4efc74785b6576220bf0ed451af45f0347550d00989d7cbb60723ed67aa55: Status 404 returned error can't find the container with id 6cb4efc74785b6576220bf0ed451af45f0347550d00989d7cbb60723ed67aa55 Jul 06 23:43:31.958334 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.958134 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34530934_f88d_47d2_90cd_1330d7844f5c.slice/crio-8307812e4bf3fa320cb2b6e8fe6d2f935dad48a698e1b6a77836bc3fae9034a3 WatchSource:0}: Error finding container 8307812e4bf3fa320cb2b6e8fe6d2f935dad48a698e1b6a77836bc3fae9034a3: Status 404 returned error can't find the container with id 8307812e4bf3fa320cb2b6e8fe6d2f935dad48a698e1b6a77836bc3fae9034a3 Jul 06 23:43:31.959379 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.959358 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda641feac_98bc_4ddd_8d99_87b2a68e1b8d.slice/crio-972cfb92b36f105f8238450a25a09e209a0148a2363f699fb02c4230fcbbdd2f WatchSource:0}: Error finding container 972cfb92b36f105f8238450a25a09e209a0148a2363f699fb02c4230fcbbdd2f: Status 404 returned error can't find the container with id 972cfb92b36f105f8238450a25a09e209a0148a2363f699fb02c4230fcbbdd2f Jul 06 23:43:31.963226 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:43:31.961379 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ff99e6_eed4_4326_8a58_dcec0181dbdf.slice/crio-85f436a17d1c3f88ef31b9208978207aa73f7832149c9193dd155234e8bdc9e3 WatchSource:0}: Error finding container 85f436a17d1c3f88ef31b9208978207aa73f7832149c9193dd155234e8bdc9e3: Status 404 returned error can't find the container with id 85f436a17d1c3f88ef31b9208978207aa73f7832149c9193dd155234e8bdc9e3 Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.451317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451613 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.451621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451641 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451657 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pfwxd for pod openshift-network-diagnostics/network-check-target-kgtsk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.451668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451721 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd podName:bfada76e-ae0e-47fa-b3e8-cc16d300476c nodeName:}" failed. No retries permitted until 2026-07-06 23:43:34.451699612 +0000 UTC m=+6.116874632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfwxd" (UniqueName: "kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd") pod "network-check-target-kgtsk" (UID: "bfada76e-ae0e-47fa-b3e8-cc16d300476c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451786 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451841 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret podName:fce18fdc-bd9b-4997-8937-d927ec259001 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:34.451823998 +0000 UTC m=+6.116999020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret") pod "global-pull-secret-syncer-6dxdx" (UID: "fce18fdc-bd9b-4997-8937-d927ec259001") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451905 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:32.452060 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.451939 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs podName:97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f nodeName:}" failed. No retries permitted until 2026-07-06 23:43:34.451926982 +0000 UTC m=+6.117102007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs") pod "network-metrics-daemon-4gcnp" (UID: "97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:32.780362 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.780272 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:38:31 +0000 UTC" deadline="2028-02-06 11:14:10.321431977 +0000 UTC" Jul 06 23:43:32.780362 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.780313 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13907h30m37.541124273s" Jul 06 23:43:32.859432 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.859402 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:32.859675 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.859643 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:32.861779 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.861624 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:32.861779 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:32.861738 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:32.890610 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.890555 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dt5dc" event={"ID":"5ff1387c-c93b-4550-b362-40131faadbb7","Type":"ContainerStarted","Data":"1b7c0e95df9f57880e35edee95b97fa621c935da339a480a9cf361f410da00bd"} Jul 06 23:43:32.905174 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.905101 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerStarted","Data":"087676da76780ea1c34c9b0a3040aa2a2993a7852d6a8d16d8c0d241a8774973"} Jul 06 23:43:32.915387 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.915319 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" event={"ID":"92840009ecdd9bea75a49d7eefaa1ddc","Type":"ContainerStarted","Data":"cc1e206e145d86c970c5a6a01a64a89bee6a445466b4398ce76a7ec6bb259390"} Jul 06 23:43:32.925867 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.925831 2556 generic.go:356] "Generic (PLEG): container finished" podID="61edf0106ebb2b4c26e7cc80b4ce80d8" containerID="ae63d0e5be48b79ea3bf237b0b1041b7b2812fa63b4e1e8a85c47a31c609ff27" exitCode=0 Jul 06 23:43:32.925962 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.925911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" event={"ID":"61edf0106ebb2b4c26e7cc80b4ce80d8","Type":"ContainerDied","Data":"ae63d0e5be48b79ea3bf237b0b1041b7b2812fa63b4e1e8a85c47a31c609ff27"} Jul 06 23:43:32.931137 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.931067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f7279" event={"ID":"a3a5678c-ebba-4ced-b5b7-8355497bc2b6","Type":"ContainerStarted","Data":"bf0a9cd387380257509bdf788fcd74270aef236db69667744596756dd6b37a6f"} Jul 06 23:43:32.932742 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.932692 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-156.ec2.internal" podStartSLOduration=2.9326754360000002 podStartE2EDuration="2.932675436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:32.932085351 +0000 UTC m=+4.597260393" watchObservedRunningTime="2026-07-06 23:43:32.932675436 +0000 UTC m=+4.597850481" Jul 06 23:43:32.948293 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.945656 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x7v8t" event={"ID":"02ff99e6-eed4-4326-8a58-dcec0181dbdf","Type":"ContainerStarted","Data":"85f436a17d1c3f88ef31b9208978207aa73f7832149c9193dd155234e8bdc9e3"} Jul 06 23:43:32.951012 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.950921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jqbh" event={"ID":"34530934-f88d-47d2-90cd-1330d7844f5c","Type":"ContainerStarted","Data":"8307812e4bf3fa320cb2b6e8fe6d2f935dad48a698e1b6a77836bc3fae9034a3"} Jul 06 23:43:32.977828 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:32.977797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" event={"ID":"2261ca51-ce32-4780-b702-58fec63fc300","Type":"ContainerStarted","Data":"6cb4efc74785b6576220bf0ed451af45f0347550d00989d7cbb60723ed67aa55"} Jul 06 23:43:33.008389 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:33.008357 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w66wc" event={"ID":"cf87aa93-c0c4-49ad-abed-995d38a63e6b","Type":"ContainerStarted","Data":"30ad504a15c5914915a60579f60a6a0832556673017d27dc2cd6a43a0c9fe88d"} Jul 06 23:43:33.013096 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:33.013067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"e1b8f18c97ae7bdb6f0818cf34af1faa407dcabb87bd17fe8cccde511528df50"} Jul 06 23:43:33.019061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:33.018805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87cqm" event={"ID":"a641feac-98bc-4ddd-8d99-87b2a68e1b8d","Type":"ContainerStarted","Data":"972cfb92b36f105f8238450a25a09e209a0148a2363f699fb02c4230fcbbdd2f"} Jul 06 23:43:33.858398 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:33.858361 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:33.858872 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:33.858504 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:34.042799 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:34.042766 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" event={"ID":"61edf0106ebb2b4c26e7cc80b4ce80d8","Type":"ContainerStarted","Data":"03f3f55491347dc1626ddd37c06e5ff2243b41e65fc94c61974f07b2da3d6123"} Jul 06 23:43:34.467320 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:34.467281 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:34.467519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:34.467344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:34.467519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:34.467384 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:34.467641 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.467546 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:43:34.467641 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.467567 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:43:34.467641 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.467581 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pfwxd for pod openshift-network-diagnostics/network-check-target-kgtsk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:34.467795 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.467691 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd podName:bfada76e-ae0e-47fa-b3e8-cc16d300476c nodeName:}" failed. No retries permitted until 2026-07-06 23:43:38.467668073 +0000 UTC m=+10.132843116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfwxd" (UniqueName: "kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd") pod "network-check-target-kgtsk" (UID: "bfada76e-ae0e-47fa-b3e8-cc16d300476c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:34.468195 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.468168 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:34.468306 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.468262 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs podName:97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f nodeName:}" failed. No retries permitted until 2026-07-06 23:43:38.468244273 +0000 UTC m=+10.133419310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs") pod "network-metrics-daemon-4gcnp" (UID: "97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:34.468387 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.468372 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:34.468452 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.468417 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret podName:fce18fdc-bd9b-4997-8937-d927ec259001 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:38.468404157 +0000 UTC m=+10.133579192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret") pod "global-pull-secret-syncer-6dxdx" (UID: "fce18fdc-bd9b-4997-8937-d927ec259001") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:34.858386 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:34.858314 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:34.858539 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.858434 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:34.860967 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:34.860944 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:34.861077 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:34.861057 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:35.857699 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:35.857667 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:35.857878 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:35.857792 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:36.859754 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:36.859723 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:36.860244 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:36.859859 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:36.860310 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:36.860242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:36.860370 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:36.860327 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:37.857713 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:37.857684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:37.857883 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:37.857795 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:38.502456 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:38.502420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:38.502480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:38.502515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502592 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502655 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502673 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502682 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pfwxd for pod openshift-network-diagnostics/network-check-target-kgtsk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502658 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret podName:fce18fdc-bd9b-4997-8937-d927ec259001 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:46.502638387 +0000 UTC m=+18.167813403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret") pod "global-pull-secret-syncer-6dxdx" (UID: "fce18fdc-bd9b-4997-8937-d927ec259001") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502726 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd podName:bfada76e-ae0e-47fa-b3e8-cc16d300476c nodeName:}" failed. No retries permitted until 2026-07-06 23:43:46.502714714 +0000 UTC m=+18.167889729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfwxd" (UniqueName: "kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd") pod "network-check-target-kgtsk" (UID: "bfada76e-ae0e-47fa-b3e8-cc16d300476c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502592 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:38.502879 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.502750 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs podName:97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f nodeName:}" failed. No retries permitted until 2026-07-06 23:43:46.502743808 +0000 UTC m=+18.167918824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs") pod "network-metrics-daemon-4gcnp" (UID: "97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:38.860375 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:38.860310 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:38.860503 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.860436 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:38.860839 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:38.860813 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:38.860945 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:38.860921 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:39.857884 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:39.857858 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:39.858217 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:39.857983 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:40.858925 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:40.858894 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:40.859417 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:40.858926 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:40.859417 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:40.859013 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:40.859417 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:40.859148 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:41.858065 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:41.857577 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:41.858065 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:41.857704 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:42.859916 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:42.858136 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:42.859916 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:42.858271 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:42.859916 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:42.858334 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:42.859916 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:42.858482 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:43.857955 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:43.857925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:43.858122 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:43.858031 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:44.857516 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:44.857484 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:44.857943 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:44.857603 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:44.857943 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:44.857931 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:44.858038 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:44.858020 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:45.857821 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:45.857783 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:45.858288 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:45.857912 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:46.564820 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:46.564795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:46.564928 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:46.564832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:46.564928 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:46.564852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:46.564986 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.564938 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:46.564986 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.564964 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:46.565084 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.564995 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs podName:97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f nodeName:}" failed. No retries permitted until 2026-07-06 23:44:02.564977912 +0000 UTC m=+34.230152928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs") pod "network-metrics-daemon-4gcnp" (UID: "97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:46.565084 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.564999 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:43:46.565084 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.565015 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:43:46.565084 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.565018 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret podName:fce18fdc-bd9b-4997-8937-d927ec259001 nodeName:}" failed. No retries permitted until 2026-07-06 23:44:02.565001328 +0000 UTC m=+34.230176347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret") pod "global-pull-secret-syncer-6dxdx" (UID: "fce18fdc-bd9b-4997-8937-d927ec259001") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:46.565084 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.565027 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pfwxd for pod openshift-network-diagnostics/network-check-target-kgtsk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:46.565084 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.565064 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd podName:bfada76e-ae0e-47fa-b3e8-cc16d300476c nodeName:}" failed. No retries permitted until 2026-07-06 23:44:02.565057264 +0000 UTC m=+34.230232280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfwxd" (UniqueName: "kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd") pod "network-check-target-kgtsk" (UID: "bfada76e-ae0e-47fa-b3e8-cc16d300476c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:46.858258 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:46.858162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:46.858660 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:46.858161 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:46.858660 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.858317 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:46.858660 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:46.858376 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:47.857443 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:47.857410 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:47.857604 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:47.857534 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:48.858772 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:48.858735 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:48.859137 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:48.858850 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:48.859264 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:48.859235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:48.859402 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:48.859351 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:49.858014 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:49.857979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:49.858160 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:49.858086 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:50.857368 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:50.857337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:50.857957 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:50.857336 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:50.857957 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:50.857488 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:50.857957 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:50.857569 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:51.858425 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:51.858084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:51.859152 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:51.858518 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:52.091765 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.091728 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dt5dc" event={"ID":"5ff1387c-c93b-4550-b362-40131faadbb7","Type":"ContainerStarted","Data":"11c9ff293d79918e47a376ff08fc71d10935420a7058b071c8c75f0a2f2827c9"} Jul 06 23:43:52.093144 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.093120 2556 generic.go:356] "Generic (PLEG): container finished" podID="b60a980f-e9bb-4213-bf7c-1eea2faab280" containerID="078ce4f1592d9d1f76f12e121407e8ab064c3bb338b9ffe45b0239e957d3f834" exitCode=0 Jul 06 23:43:52.093279 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.093210 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerDied","Data":"078ce4f1592d9d1f76f12e121407e8ab064c3bb338b9ffe45b0239e957d3f834"} Jul 06 23:43:52.094674 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.094655 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f7279" event={"ID":"a3a5678c-ebba-4ced-b5b7-8355497bc2b6","Type":"ContainerStarted","Data":"3285d14250c287e193be5898de3254369d2d33c86c319d1da53132e219fc306a"} Jul 06 23:43:52.096207 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.096168 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x7v8t" event={"ID":"02ff99e6-eed4-4326-8a58-dcec0181dbdf","Type":"ContainerStarted","Data":"308476e0d2fbae1c3e958ab7ea7dbbfded5e6ad2217c0e0697d0f3404850f5e2"} Jul 06 23:43:52.097588 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.097567 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" event={"ID":"2261ca51-ce32-4780-b702-58fec63fc300","Type":"ContainerStarted","Data":"8391866e31f64751e6b252b361e98b6a0603937456b33a17720888f195400987"} Jul 06 23:43:52.098797 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.098777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w66wc" event={"ID":"cf87aa93-c0c4-49ad-abed-995d38a63e6b","Type":"ContainerStarted","Data":"d140cf41e5a73e03d567ca63878a14c37901903dda43ddb3e715e77518816847"} Jul 06 23:43:52.101565 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.101548 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"7b2eb08c59d5916492a651894141534ce471f8f1ad04e0fc2856a952b5b42ed7"} Jul 06 23:43:52.101672 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.101596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"eb8f648742bad13be5eabeb6ce07839cd7ef6f34b6c019bb5a4d959e5393a66f"} Jul 06 23:43:52.101672 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.101631 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"3db789bea9dcac698779eb6c3adad9c334e27e689e9e8d762602456f9a8d80ec"} Jul 06 23:43:52.101672 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.101665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"8b155579b6aae0acb00d9647c6bb53d9659757a26df298b0c68398e8b74341b0"} Jul 06 23:43:52.101811 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.101704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"9c035999c8ed720c79f59a304365edb1121b74e222bf79d0783c9327af3701ac"} Jul 06 23:43:52.101811 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.101733 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"a2981035f76164a5b210cdc2e96d8925d28ce3f44b2c3b33c7f7f3478f5d508a"} Jul 06 23:43:52.102941 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.102926 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87cqm" event={"ID":"a641feac-98bc-4ddd-8d99-87b2a68e1b8d","Type":"ContainerStarted","Data":"dd8aa91ad33c715be5121dbac354b717f2ef0ad91f01fae1fde9764773f15de2"} Jul 06 23:43:52.108790 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.108753 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dt5dc" podStartSLOduration=4.079630221 podStartE2EDuration="23.10874053s" totalImagesPullingTime="19.029110309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:52.108127212 +0000 UTC m=+23.773302246" watchObservedRunningTime="2026-07-06 23:43:52.10874053 +0000 UTC m=+23.773915567" Jul 06 23:43:52.108863 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.108822 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-156.ec2.internal" podStartSLOduration=22.108815921 podStartE2EDuration="22.108815921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:34.060987554 +0000 UTC m=+5.726162615" watchObservedRunningTime="2026-07-06 23:43:52.108815921 +0000 UTC m=+23.773990960" Jul 06 23:43:52.140279 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.140239 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w66wc" podStartSLOduration=8.586341402 podStartE2EDuration="23.140227167s" totalImagesPullingTime="14.553885765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:52.139943795 +0000 UTC m=+23.805118835" watchObservedRunningTime="2026-07-06 23:43:52.140227167 +0000 UTC m=+23.805402204" Jul 06 23:43:52.170443 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.170395 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x7v8t" podStartSLOduration=4.2190734 podStartE2EDuration="23.170383422s" totalImagesPullingTime="18.951310022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:52.154590829 +0000 UTC m=+23.819765867" watchObservedRunningTime="2026-07-06 23:43:52.170383422 +0000 UTC m=+23.835558459" Jul 06 23:43:52.170528 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.170467 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f7279" podStartSLOduration=4.101221232 podStartE2EDuration="23.170463364s" totalImagesPullingTime="19.069242132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:52.170363788 +0000 UTC m=+23.835538826" watchObservedRunningTime="2026-07-06 23:43:52.170463364 +0000 UTC m=+23.835638401" Jul 06 23:43:52.185685 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.185647 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-87cqm" podStartSLOduration=4.167348511 podStartE2EDuration="23.18563621s" totalImagesPullingTime="19.018287699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:52.185572067 +0000 UTC m=+23.850747106" watchObservedRunningTime="2026-07-06 23:43:52.18563621 +0000 UTC m=+23.850811247" Jul 06 23:43:52.475609 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.475587 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 23:43:52.792205 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.792064 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:43:52.475606245Z","UUID":"2f7f96bc-3798-454c-b7bb-892306cc2dda","Handler":null,"Name":"","Endpoint":""} Jul 06 23:43:52.793628 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.793595 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 23:43:52.793738 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.793650 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 23:43:52.857367 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.857346 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:52.857479 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:52.857438 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:52.857540 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:52.857526 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:52.857634 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:52.857618 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:53.105960 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:53.105879 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jqbh" event={"ID":"34530934-f88d-47d2-90cd-1330d7844f5c","Type":"ContainerStarted","Data":"90d7c1754fb9e516f935ca5226ad22f55d356fb09f785aac966665ec9570f357"} Jul 06 23:43:53.107729 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:53.107704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" event={"ID":"2261ca51-ce32-4780-b702-58fec63fc300","Type":"ContainerStarted","Data":"f39ed0ab7a7bc7fd7051ee9e18a39369e61531629eb29753fcb19296b9141dc1"} Jul 06 23:43:53.120971 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:53.120924 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7jqbh" podStartSLOduration=5.165649475 podStartE2EDuration="24.120910347s" totalImagesPullingTime="18.955260872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:53.120879457 +0000 UTC m=+24.786054496" watchObservedRunningTime="2026-07-06 23:43:53.120910347 +0000 UTC m=+24.786085385" Jul 06 23:43:53.858044 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:53.858018 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:53.858178 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:53.858143 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:54.112599 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:54.112523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" event={"ID":"2261ca51-ce32-4780-b702-58fec63fc300","Type":"ContainerStarted","Data":"30a59c83a1a5fbc886f5238d0909e62a5a20ea577cb2e2061675114766aefaa6"} Jul 06 23:43:54.116898 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:54.116876 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"d7a205b60bf5cf2432e607a5fd1776fdfb6e8d321a1af31255481189ce0b2e70"} Jul 06 23:43:54.131278 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:54.131237 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95gv" podStartSLOduration=3.992923303 podStartE2EDuration="25.131219744s" totalImagesPullingTime="21.138296441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:54.131153723 +0000 UTC m=+25.796328762" watchObservedRunningTime="2026-07-06 23:43:54.131219744 +0000 UTC m=+25.796394776" Jul 06 23:43:54.857914 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:54.857759 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:54.858163 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:54.857759 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:54.858163 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:54.857999 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:54.858163 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:54.858096 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:55.745881 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:55.745853 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:55.746488 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:55.746469 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:55.857765 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:55.857737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:55.857965 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:55.857847 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:56.120423 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:56.120336 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:56.120845 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:56.120826 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w66wc" Jul 06 23:43:56.858453 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:56.858216 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:56.859098 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:56.858271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:56.859098 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:56.858487 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:56.859098 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:56.858577 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:57.125157 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.125095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" event={"ID":"83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3","Type":"ContainerStarted","Data":"1384dfc0ab81c03e44073a3243ea923a657c11b8995d19ac48e96fd89a934a99"} Jul 06 23:43:57.125496 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.125451 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:57.125572 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.125530 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:57.127148 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.127123 2556 generic.go:356] "Generic (PLEG): container finished" podID="b60a980f-e9bb-4213-bf7c-1eea2faab280" containerID="d1eb9b961695de69ee06984712f8bb42ed4740d87169e88b3ee003128467f6f7" exitCode=0 Jul 06 23:43:57.127261 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.127219 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerDied","Data":"d1eb9b961695de69ee06984712f8bb42ed4740d87169e88b3ee003128467f6f7"} Jul 06 23:43:57.140479 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.140461 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:57.154710 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.154675 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" podStartSLOduration=9.067476857 podStartE2EDuration="28.154659101s" totalImagesPullingTime="19.087182244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:57.154277622 +0000 UTC m=+28.819452671" watchObservedRunningTime="2026-07-06 23:43:57.154659101 +0000 UTC m=+28.819834139" Jul 06 23:43:57.857488 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:57.857453 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:57.857699 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:57.857545 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:43:58.129667 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:58.129595 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:58.144394 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:58.144370 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:43:58.858158 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:58.858136 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:43:58.858315 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:58.858235 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:43:58.858363 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:58.858331 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:43:58.858505 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:58.858486 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:43:59.133694 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:59.133617 2556 generic.go:356] "Generic (PLEG): container finished" podID="b60a980f-e9bb-4213-bf7c-1eea2faab280" containerID="2fcf3ddb7ab9d4e6dc17b9f555fda25a891e591e1443071e4c93813bdc9f5e92" exitCode=0 Jul 06 23:43:59.133694 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:59.133678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerDied","Data":"2fcf3ddb7ab9d4e6dc17b9f555fda25a891e591e1443071e4c93813bdc9f5e92"} Jul 06 23:43:59.857628 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:43:59.857600 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:43:59.857758 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:43:59.857686 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:44:00.857739 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:00.857708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:00.858238 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:00.857843 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:44:00.858238 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:00.857893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:00.858238 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:00.857986 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:44:01.140747 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:01.140682 2556 generic.go:356] "Generic (PLEG): container finished" podID="b60a980f-e9bb-4213-bf7c-1eea2faab280" containerID="b8f014fa431faba4ce72d6dc1b80a7415df50132b5658846dba2c50f54cf5060" exitCode=0 Jul 06 23:44:01.140747 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:01.140732 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerDied","Data":"b8f014fa431faba4ce72d6dc1b80a7415df50132b5658846dba2c50f54cf5060"} Jul 06 23:44:01.858401 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:01.857912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:01.858401 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:01.858021 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:44:02.593744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.593553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:02.593744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.593617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:02.593744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.593665 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:02.594033 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.593914 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:44:02.594033 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.593937 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:44:02.594033 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.593947 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pfwxd for pod openshift-network-diagnostics/network-check-target-kgtsk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:44:02.594033 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.594001 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd podName:bfada76e-ae0e-47fa-b3e8-cc16d300476c nodeName:}" failed. No retries permitted until 2026-07-06 23:44:34.593986226 +0000 UTC m=+66.259161243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfwxd" (UniqueName: "kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd") pod "network-check-target-kgtsk" (UID: "bfada76e-ae0e-47fa-b3e8-cc16d300476c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:44:02.594464 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.594440 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:44:02.594592 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.594500 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs podName:97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f nodeName:}" failed. No retries permitted until 2026-07-06 23:44:34.594487765 +0000 UTC m=+66.259662780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs") pod "network-metrics-daemon-4gcnp" (UID: "97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:44:02.594592 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.594587 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:44:02.594723 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.594629 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret podName:fce18fdc-bd9b-4997-8937-d927ec259001 nodeName:}" failed. No retries permitted until 2026-07-06 23:44:34.59461673 +0000 UTC m=+66.259791746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret") pod "global-pull-secret-syncer-6dxdx" (UID: "fce18fdc-bd9b-4997-8937-d927ec259001") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:44:02.858018 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.857944 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:02.858129 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.857945 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:02.858129 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.858078 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:44:02.858260 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.858141 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:44:02.995633 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.995600 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6dxdx"] Jul 06 23:44:02.996028 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.995731 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:02.996028 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:02.995839 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:44:02.999004 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.998607 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgtsk"] Jul 06 23:44:02.999476 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:02.999446 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4gcnp"] Jul 06 23:44:03.146091 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:03.146021 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:03.146091 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:03.146071 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:03.146286 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:03.146226 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:44:03.146326 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:03.146288 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:44:04.858478 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:04.858247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:04.858864 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:04.858251 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:04.858864 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:04.858591 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:44:04.858864 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:04.858664 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:44:04.858864 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:04.858287 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:04.858864 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:04.858764 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:44:06.155742 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:06.155714 2556 generic.go:356] "Generic (PLEG): container finished" podID="b60a980f-e9bb-4213-bf7c-1eea2faab280" containerID="cd14c593c7b6f6b6343e6c4b07f28056fe6c2567eafc2501517b68510832a9ba" exitCode=0 Jul 06 23:44:06.156136 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:06.155748 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerDied","Data":"cd14c593c7b6f6b6343e6c4b07f28056fe6c2567eafc2501517b68510832a9ba"} Jul 06 23:44:06.857700 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:06.857635 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:06.857830 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:06.857642 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:06.857830 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:06.857749 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dxdx" podUID="fce18fdc-bd9b-4997-8937-d927ec259001" Jul 06 23:44:06.857941 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:06.857848 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gcnp" podUID="97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f" Jul 06 23:44:06.857941 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:06.857883 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:06.858042 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:06.857961 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgtsk" podUID="bfada76e-ae0e-47fa-b3e8-cc16d300476c" Jul 06 23:44:07.092329 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.092301 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-156.ec2.internal" event="NodeReady" Jul 06 23:44:07.092464 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.092397 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 23:44:07.142315 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.142261 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hfffx"] Jul 06 23:44:07.143930 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.143914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.146930 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.146911 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 23:44:07.147026 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.146931 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h6mrd\"" Jul 06 23:44:07.147026 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.146911 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 23:44:07.150974 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.150950 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f9gjs"] Jul 06 23:44:07.152995 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.152979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.157892 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.157843 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 23:44:07.158351 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.158157 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7np4z\"" Jul 06 23:44:07.158514 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.158458 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 23:44:07.160830 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.160807 2556 generic.go:356] "Generic (PLEG): container finished" podID="b60a980f-e9bb-4213-bf7c-1eea2faab280" containerID="bb5d427e281e95ae2e73b099cd851daf29f210af0425d0c0cb2f383f8b8ad74a" exitCode=0 Jul 06 23:44:07.160931 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.160868 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerDied","Data":"bb5d427e281e95ae2e73b099cd851daf29f210af0425d0c0cb2f383f8b8ad74a"} Jul 06 23:44:07.160995 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.160974 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 23:44:07.162140 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.162124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfffx"] Jul 06 23:44:07.170166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.170143 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f9gjs"] Jul 06 23:44:07.183777 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.183758 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b45pp"] Jul 06 23:44:07.186406 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.186389 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.190800 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.190781 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qjnpx\"" Jul 06 23:44:07.191170 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.191152 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 23:44:07.191395 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.191377 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 23:44:07.191584 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.191568 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 23:44:07.191696 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.191676 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 23:44:07.197827 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.197804 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b45pp"] Jul 06 23:44:07.229053 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.229024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b080658-9569-47e1-80e1-d828660d3e4d-metrics-tls\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.229139 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.229070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b080658-9569-47e1-80e1-d828660d3e4d-config-volume\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.229139 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.229096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnmw\" (UniqueName: \"kubernetes.io/projected/8b080658-9569-47e1-80e1-d828660d3e4d-kube-api-access-cfnmw\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.229232 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.229156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b080658-9569-47e1-80e1-d828660d3e4d-tmp-dir\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.329760 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329738 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b080658-9569-47e1-80e1-d828660d3e4d-metrics-tls\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.329856 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceb523eb-2f3e-4180-a331-fc097950d160-crio-socket\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.329856 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceb523eb-2f3e-4180-a331-fc097950d160-data-volume\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.329856 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceb523eb-2f3e-4180-a331-fc097950d160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.329856 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-924w4\" (UniqueName: \"kubernetes.io/projected/ceb523eb-2f3e-4180-a331-fc097950d160-kube-api-access-924w4\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.330016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b080658-9569-47e1-80e1-d828660d3e4d-config-volume\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.330016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnmw\" (UniqueName: \"kubernetes.io/projected/8b080658-9569-47e1-80e1-d828660d3e4d-kube-api-access-cfnmw\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.330016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.329927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b080658-9569-47e1-80e1-d828660d3e4d-tmp-dir\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.330233 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.330081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c9b08e-3fce-481a-a014-3979292c5e15-cert\") pod \"ingress-canary-f9gjs\" (UID: \"16c9b08e-3fce-481a-a014-3979292c5e15\") " pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.330311 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.330291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tt2\" (UniqueName: \"kubernetes.io/projected/16c9b08e-3fce-481a-a014-3979292c5e15-kube-api-access-p5tt2\") pod \"ingress-canary-f9gjs\" (UID: \"16c9b08e-3fce-481a-a014-3979292c5e15\") " pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.330369 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.330316 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b080658-9569-47e1-80e1-d828660d3e4d-tmp-dir\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.330369 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.330330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceb523eb-2f3e-4180-a331-fc097950d160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.330561 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.330542 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b080658-9569-47e1-80e1-d828660d3e4d-config-volume\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.333863 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.333843 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b080658-9569-47e1-80e1-d828660d3e4d-metrics-tls\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.342849 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.342825 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnmw\" (UniqueName: \"kubernetes.io/projected/8b080658-9569-47e1-80e1-d828660d3e4d-kube-api-access-cfnmw\") pod \"dns-default-hfffx\" (UID: \"8b080658-9569-47e1-80e1-d828660d3e4d\") " pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.431415 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tt2\" (UniqueName: \"kubernetes.io/projected/16c9b08e-3fce-481a-a014-3979292c5e15-kube-api-access-p5tt2\") pod \"ingress-canary-f9gjs\" (UID: \"16c9b08e-3fce-481a-a014-3979292c5e15\") " pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.431520 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceb523eb-2f3e-4180-a331-fc097950d160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.431520 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431459 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceb523eb-2f3e-4180-a331-fc097950d160-crio-socket\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.431520 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceb523eb-2f3e-4180-a331-fc097950d160-data-volume\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.431520 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceb523eb-2f3e-4180-a331-fc097950d160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.431715 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-924w4\" (UniqueName: \"kubernetes.io/projected/ceb523eb-2f3e-4180-a331-fc097950d160-kube-api-access-924w4\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.431715 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c9b08e-3fce-481a-a014-3979292c5e15-cert\") pod \"ingress-canary-f9gjs\" (UID: \"16c9b08e-3fce-481a-a014-3979292c5e15\") " pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.431715 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431594 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceb523eb-2f3e-4180-a331-fc097950d160-crio-socket\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.431918 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.431890 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceb523eb-2f3e-4180-a331-fc097950d160-data-volume\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.432114 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.432095 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceb523eb-2f3e-4180-a331-fc097950d160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.433543 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.433518 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceb523eb-2f3e-4180-a331-fc097950d160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.433943 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.433926 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c9b08e-3fce-481a-a014-3979292c5e15-cert\") pod \"ingress-canary-f9gjs\" (UID: \"16c9b08e-3fce-481a-a014-3979292c5e15\") " pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.447430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.447410 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-924w4\" (UniqueName: \"kubernetes.io/projected/ceb523eb-2f3e-4180-a331-fc097950d160-kube-api-access-924w4\") pod \"insights-runtime-extractor-b45pp\" (UID: \"ceb523eb-2f3e-4180-a331-fc097950d160\") " pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.448068 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.448051 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tt2\" (UniqueName: \"kubernetes.io/projected/16c9b08e-3fce-481a-a014-3979292c5e15-kube-api-access-p5tt2\") pod \"ingress-canary-f9gjs\" (UID: \"16c9b08e-3fce-481a-a014-3979292c5e15\") " pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.452866 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.452853 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:07.461337 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.461315 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f9gjs" Jul 06 23:44:07.499623 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.499414 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b45pp" Jul 06 23:44:07.606101 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.606077 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfffx"] Jul 06 23:44:07.609605 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.609584 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f9gjs"] Jul 06 23:44:07.610599 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:07.610506 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b080658_9569_47e1_80e1_d828660d3e4d.slice/crio-c34bbb1302d7629a81ecc00ba851e6cdfcff7a8d4f42e18f1bd706c524ea4915 WatchSource:0}: Error finding container c34bbb1302d7629a81ecc00ba851e6cdfcff7a8d4f42e18f1bd706c524ea4915: Status 404 returned error can't find the container with id c34bbb1302d7629a81ecc00ba851e6cdfcff7a8d4f42e18f1bd706c524ea4915 Jul 06 23:44:07.615012 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:07.614035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c9b08e_3fce_481a_a014_3979292c5e15.slice/crio-2f0c8db537369c08fb38f365a7e236617e39e67e3b67c6311081867e2f9b2dba WatchSource:0}: Error finding container 2f0c8db537369c08fb38f365a7e236617e39e67e3b67c6311081867e2f9b2dba: Status 404 returned error can't find the container with id 2f0c8db537369c08fb38f365a7e236617e39e67e3b67c6311081867e2f9b2dba Jul 06 23:44:07.641728 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:07.641708 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b45pp"] Jul 06 23:44:07.644237 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:07.644216 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb523eb_2f3e_4180_a331_fc097950d160.slice/crio-a26060471d20b4848a642182c6a6b1556d1da3e04411efe37c76c48a1d821b33 WatchSource:0}: Error finding container a26060471d20b4848a642182c6a6b1556d1da3e04411efe37c76c48a1d821b33: Status 404 returned error can't find the container with id a26060471d20b4848a642182c6a6b1556d1da3e04411efe37c76c48a1d821b33 Jul 06 23:44:08.170598 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.169685 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" event={"ID":"b60a980f-e9bb-4213-bf7c-1eea2faab280","Type":"ContainerStarted","Data":"e595a34151dd0965f0609d11f5c9e1c88dd1c333423c955d534a3f6052c3cb33"} Jul 06 23:44:08.172528 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.172501 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b45pp" event={"ID":"ceb523eb-2f3e-4180-a331-fc097950d160","Type":"ContainerStarted","Data":"a26060471d20b4848a642182c6a6b1556d1da3e04411efe37c76c48a1d821b33"} Jul 06 23:44:08.173989 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.173958 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f9gjs" event={"ID":"16c9b08e-3fce-481a-a014-3979292c5e15","Type":"ContainerStarted","Data":"2f0c8db537369c08fb38f365a7e236617e39e67e3b67c6311081867e2f9b2dba"} Jul 06 23:44:08.175114 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.175088 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfffx" event={"ID":"8b080658-9569-47e1-80e1-d828660d3e4d","Type":"ContainerStarted","Data":"c34bbb1302d7629a81ecc00ba851e6cdfcff7a8d4f42e18f1bd706c524ea4915"} Jul 06 23:44:08.194882 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.194832 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d4dzf" podStartSLOduration=8.679794604 podStartE2EDuration="39.194785817s" totalImagesPullingTime="30.514991213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:08.19333998 +0000 UTC m=+39.858515044" watchObservedRunningTime="2026-07-06 23:44:08.194785817 +0000 UTC m=+39.859960856" Jul 06 23:44:08.861178 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.860336 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:08.861178 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.860730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:08.861178 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.861088 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:08.867762 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.867737 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:44:08.868297 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.868274 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xv6vb\"" Jul 06 23:44:08.869482 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.868511 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:44:08.869482 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.868592 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:44:08.869482 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.868744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m52g\"" Jul 06 23:44:08.869482 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:08.868843 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:44:10.175362 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.175327 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5"] Jul 06 23:44:10.197258 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.197230 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5"] Jul 06 23:44:10.197408 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.197293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" Jul 06 23:44:10.200036 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.200009 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 23:44:10.200211 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.200173 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pnpfr\"" Jul 06 23:44:10.354165 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.354135 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e16eede5-4a81-4edb-aa79-84fa44c4c9d0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-p8ft5\" (UID: \"e16eede5-4a81-4edb-aa79-84fa44c4c9d0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" Jul 06 23:44:10.455387 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.455310 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e16eede5-4a81-4edb-aa79-84fa44c4c9d0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-p8ft5\" (UID: \"e16eede5-4a81-4edb-aa79-84fa44c4c9d0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" Jul 06 23:44:10.459408 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.459352 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e16eede5-4a81-4edb-aa79-84fa44c4c9d0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-p8ft5\" (UID: \"e16eede5-4a81-4edb-aa79-84fa44c4c9d0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" Jul 06 23:44:10.507238 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.507216 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" Jul 06 23:44:10.563412 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.563385 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-655bc5c784-wst2j"] Jul 06 23:44:10.586787 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.586748 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655bc5c784-wst2j"] Jul 06 23:44:10.586905 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.586850 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.589813 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.589786 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 23:44:10.590929 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.590907 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vjf5d\"" Jul 06 23:44:10.591171 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.591154 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 23:44:10.591401 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.591381 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 23:44:10.592027 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.592002 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 23:44:10.592136 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.592090 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 23:44:10.592223 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.592187 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 23:44:10.592331 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.592313 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 23:44:10.597336 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.597316 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 23:44:10.757932 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.757880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-oauth-config\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.757932 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.757914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-serving-cert\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.757932 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.757930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-trusted-ca-bundle\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.758071 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.757945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-oauth-serving-cert\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.758071 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.758035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxzt\" (UniqueName: \"kubernetes.io/projected/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-kube-api-access-5kxzt\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.758135 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.758082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-service-ca\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.758166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.758139 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-config\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.858527 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.858505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-oauth-serving-cert\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.858613 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.858570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxzt\" (UniqueName: \"kubernetes.io/projected/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-kube-api-access-5kxzt\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.858671 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.858626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-service-ca\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.858671 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.858666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-config\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.858760 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.858694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-oauth-config\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.858760 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.858734 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-serving-cert\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.858845 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.858760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-trusted-ca-bundle\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.859386 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.859345 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-oauth-serving-cert\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.859386 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.859363 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-config\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.859534 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.859355 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-service-ca\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.860308 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.860291 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-trusted-ca-bundle\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.861462 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.861438 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-oauth-config\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.861678 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.861659 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-serving-cert\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.866927 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.866908 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxzt\" (UniqueName: \"kubernetes.io/projected/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-kube-api-access-5kxzt\") pod \"console-655bc5c784-wst2j\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:10.898379 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:10.898358 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:13.996345 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:13.996322 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655bc5c784-wst2j"] Jul 06 23:44:14.000456 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:14.000424 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde90b3e7_c8b0_4dc7_820b_39f8ce57601f.slice/crio-746729bcc86c9d3d88154b36f5ac02b9d1bfa0e3e7d49f6660ac282098a88f0d WatchSource:0}: Error finding container 746729bcc86c9d3d88154b36f5ac02b9d1bfa0e3e7d49f6660ac282098a88f0d: Status 404 returned error can't find the container with id 746729bcc86c9d3d88154b36f5ac02b9d1bfa0e3e7d49f6660ac282098a88f0d Jul 06 23:44:14.007169 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:14.007140 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5"] Jul 06 23:44:14.101555 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:14.101483 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16eede5_4a81_4edb_aa79_84fa44c4c9d0.slice/crio-17ff0d8e35773b5fda5f16782e76309242731d1ea15f418b04b7d0e8896cfda0 WatchSource:0}: Error finding container 17ff0d8e35773b5fda5f16782e76309242731d1ea15f418b04b7d0e8896cfda0: Status 404 returned error can't find the container with id 17ff0d8e35773b5fda5f16782e76309242731d1ea15f418b04b7d0e8896cfda0 Jul 06 23:44:14.193693 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:14.193659 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f9gjs" event={"ID":"16c9b08e-3fce-481a-a014-3979292c5e15","Type":"ContainerStarted","Data":"c68183999470f1ea33b45f2730e57af628fb1b4add7cf578893a3a8176489e88"} Jul 06 23:44:14.194832 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:14.194809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" event={"ID":"e16eede5-4a81-4edb-aa79-84fa44c4c9d0","Type":"ContainerStarted","Data":"17ff0d8e35773b5fda5f16782e76309242731d1ea15f418b04b7d0e8896cfda0"} Jul 06 23:44:14.196284 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:14.196267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfffx" event={"ID":"8b080658-9569-47e1-80e1-d828660d3e4d","Type":"ContainerStarted","Data":"47c99039b6631ff1bb4bc376ebe29a2215c3874d6f190d265af2a3103010a167"} Jul 06 23:44:14.197283 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:14.197261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655bc5c784-wst2j" event={"ID":"de90b3e7-c8b0-4dc7-820b-39f8ce57601f","Type":"ContainerStarted","Data":"746729bcc86c9d3d88154b36f5ac02b9d1bfa0e3e7d49f6660ac282098a88f0d"} Jul 06 23:44:14.210030 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:14.209973 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f9gjs" podStartSLOduration=0.974420789 podStartE2EDuration="7.209959063s" totalImagesPullingTime="6.235538274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:14.209604866 +0000 UTC m=+45.874779953" watchObservedRunningTime="2026-07-06 23:44:14.209959063 +0000 UTC m=+45.875134103" Jul 06 23:44:15.201957 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:15.201888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b45pp" event={"ID":"ceb523eb-2f3e-4180-a331-fc097950d160","Type":"ContainerStarted","Data":"ce8bcfc40928e592c372411e70195913dc5fe73f7b40fdf28f56a82911c3144f"} Jul 06 23:44:15.203847 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:15.203817 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfffx" event={"ID":"8b080658-9569-47e1-80e1-d828660d3e4d","Type":"ContainerStarted","Data":"6207d042c02ac48ddcfd8093b7e7d48dd8c3f6f3196604d14308855c3dae7c7f"} Jul 06 23:44:15.223016 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:15.222967 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hfffx" podStartSLOduration=1.989253486 podStartE2EDuration="8.222948385s" totalImagesPullingTime="6.233694899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:15.220969874 +0000 UTC m=+46.886145122" watchObservedRunningTime="2026-07-06 23:44:15.222948385 +0000 UTC m=+46.888123423" Jul 06 23:44:16.211846 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:16.211798 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b45pp" event={"ID":"ceb523eb-2f3e-4180-a331-fc097950d160","Type":"ContainerStarted","Data":"5cf96e85c58f09d7ab5fcf801b6a1e190467ff13a05b0e3c7bf723976c688b48"} Jul 06 23:44:16.212252 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:16.211909 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:17.216838 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:17.216808 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" event={"ID":"e16eede5-4a81-4edb-aa79-84fa44c4c9d0","Type":"ContainerStarted","Data":"ff449efd0120a39c6c632fe790977df3b4af64187fd2d83b069b806445ee5415"} Jul 06 23:44:17.217246 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:17.217224 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" Jul 06 23:44:17.218161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:17.218141 2556 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-d559d66d5-p8ft5 container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/healthz\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 06 23:44:17.218262 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:17.218186 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" podUID="e16eede5-4a81-4edb-aa79-84fa44c4c9d0" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.134.0.9:8443/healthz\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 06 23:44:17.233392 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:17.233237 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" podStartSLOduration=4.225563317 podStartE2EDuration="7.233221304s" totalImagesPullingTime="3.007657987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:17.232984335 +0000 UTC m=+48.898159373" watchObservedRunningTime="2026-07-06 23:44:17.233221304 +0000 UTC m=+48.898396344" Jul 06 23:44:18.221935 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:18.221902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655bc5c784-wst2j" event={"ID":"de90b3e7-c8b0-4dc7-820b-39f8ce57601f","Type":"ContainerStarted","Data":"f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01"} Jul 06 23:44:18.227152 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:18.227127 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-p8ft5" Jul 06 23:44:18.242793 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:18.242745 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-655bc5c784-wst2j" podStartSLOduration=4.791302976 podStartE2EDuration="8.242725199s" totalImagesPullingTime="3.451422223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:18.24182587 +0000 UTC m=+49.907000910" watchObservedRunningTime="2026-07-06 23:44:18.242725199 +0000 UTC m=+49.907900242" Jul 06 23:44:20.231127 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:20.231048 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b45pp" event={"ID":"ceb523eb-2f3e-4180-a331-fc097950d160","Type":"ContainerStarted","Data":"c53d2914d82a9efe2995aa2c07f14abeb7078243ec568574c7b30639cb4a24f0"} Jul 06 23:44:20.249986 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:20.249933 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b45pp" podStartSLOduration=1.172834518 podStartE2EDuration="13.249919452s" totalImagesPullingTime="12.077084934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:44:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:20.249283307 +0000 UTC m=+51.914458337" watchObservedRunningTime="2026-07-06 23:44:20.249919452 +0000 UTC m=+51.915094517" Jul 06 23:44:20.899213 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:20.899172 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:20.899464 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:20.899251 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:20.903501 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:20.903480 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:21.240086 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:21.240022 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:44:23.219652 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.219616 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hfffx" Jul 06 23:44:23.633731 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.633647 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4"] Jul 06 23:44:23.656437 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.656413 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s7crt"] Jul 06 23:44:23.656597 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.656556 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.659516 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.659495 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 23:44:23.659705 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.659552 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 23:44:23.659824 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.659807 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 23:44:23.659895 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.659819 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 23:44:23.659895 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.659836 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 23:44:23.660976 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.660957 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7fwsm\"" Jul 06 23:44:23.676347 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.676329 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4"] Jul 06 23:44:23.676437 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.676373 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9"] Jul 06 23:44:23.676496 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.676436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.678988 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.678971 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 23:44:23.679491 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.679475 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-57rgw\"" Jul 06 23:44:23.679720 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.679702 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 23:44:23.679784 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.679751 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 23:44:23.698523 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.698494 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9"] Jul 06 23:44:23.698629 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.698598 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.701260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.701242 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9p5zd\"" Jul 06 23:44:23.701383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.701244 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 23:44:23.701506 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.701491 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 23:44:23.701819 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.701804 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 23:44:23.763440 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.763529 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763442 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.763529 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763459 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx2qf\" (UniqueName: \"kubernetes.io/projected/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-api-access-jx2qf\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.763529 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763481 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkvw\" (UniqueName: \"kubernetes.io/projected/6245d8bc-cfa0-4153-a2ed-0a199b03606b-kube-api-access-tfkvw\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.763529 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-root\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.763718 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.763718 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csvxd\" (UniqueName: \"kubernetes.io/projected/14b1ea91-76fb-47e4-b343-b3b02748c981-kube-api-access-csvxd\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.763718 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763647 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.763718 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763681 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-sys\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.763718 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-textfile\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.763922 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14b1ea91-76fb-47e4-b343-b3b02748c981-metrics-client-ca\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.763922 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763806 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.763922 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.763922 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.763922 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.763922 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.763922 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-tls\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.764141 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763943 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6245d8bc-cfa0-4153-a2ed-0a199b03606b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.764141 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.763957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-wtmp\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.864636 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.864736 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx2qf\" (UniqueName: \"kubernetes.io/projected/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-api-access-jx2qf\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.864736 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864675 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkvw\" (UniqueName: \"kubernetes.io/projected/6245d8bc-cfa0-4153-a2ed-0a199b03606b-kube-api-access-tfkvw\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.864736 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-root\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.864880 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864749 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-root\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.864880 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.864880 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864871 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csvxd\" (UniqueName: \"kubernetes.io/projected/14b1ea91-76fb-47e4-b343-b3b02748c981-kube-api-access-csvxd\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865035 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.865035 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864911 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-sys\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865035 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-textfile\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865035 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.864946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14b1ea91-76fb-47e4-b343-b3b02748c981-metrics-client-ca\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865035 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:23.865007 2556 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 23:44:23.865035 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865022 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-sys\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:23.865076 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-tls podName:c0bff359-d95f-47d8-bdc4-51c00eca4ce6 nodeName:}" failed. No retries permitted until 2026-07-06 23:44:24.365057648 +0000 UTC m=+56.030232670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-mkbr9" (UID: "c0bff359-d95f-47d8-bdc4-51c00eca4ce6") : secret "kube-state-metrics-tls" not found Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865140 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865169 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-tls\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6245d8bc-cfa0-4153-a2ed-0a199b03606b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865303 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-wtmp\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865323 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.865384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865355 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-textfile\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.866129 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:23.865449 2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 23:44:23.866129 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:44:23.865492 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-tls podName:6245d8bc-cfa0-4153-a2ed-0a199b03606b nodeName:}" failed. No retries permitted until 2026-07-06 23:44:24.365478708 +0000 UTC m=+56.030653724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-s8wh4" (UID: "6245d8bc-cfa0-4153-a2ed-0a199b03606b") : secret "openshift-state-metrics-tls" not found Jul 06 23:44:23.866129 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865581 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.866129 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865606 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14b1ea91-76fb-47e4-b343-b3b02748c981-metrics-client-ca\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.866129 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865746 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-wtmp\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.866129 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.865779 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.866535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.866509 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6245d8bc-cfa0-4153-a2ed-0a199b03606b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.866535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.866527 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.867383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.867358 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.867645 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.867624 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.867845 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.867828 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14b1ea91-76fb-47e4-b343-b3b02748c981-node-exporter-tls\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.868134 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.868112 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.875520 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.875501 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csvxd\" (UniqueName: \"kubernetes.io/projected/14b1ea91-76fb-47e4-b343-b3b02748c981-kube-api-access-csvxd\") pod \"node-exporter-s7crt\" (UID: \"14b1ea91-76fb-47e4-b343-b3b02748c981\") " pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:23.875903 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.875877 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx2qf\" (UniqueName: \"kubernetes.io/projected/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-api-access-jx2qf\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:23.876471 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.876450 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkvw\" (UniqueName: \"kubernetes.io/projected/6245d8bc-cfa0-4153-a2ed-0a199b03606b-kube-api-access-tfkvw\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:23.985433 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:23.985412 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7crt" Jul 06 23:44:24.019063 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:24.019039 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b1ea91_76fb_47e4_b343_b3b02748c981.slice/crio-5a8aa328b2f21f946d253895ebdf996901b469a5d8bea906cec5d671086774d4 WatchSource:0}: Error finding container 5a8aa328b2f21f946d253895ebdf996901b469a5d8bea906cec5d671086774d4: Status 404 returned error can't find the container with id 5a8aa328b2f21f946d253895ebdf996901b469a5d8bea906cec5d671086774d4 Jul 06 23:44:24.247394 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.247335 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7crt" event={"ID":"14b1ea91-76fb-47e4-b343-b3b02748c981","Type":"ContainerStarted","Data":"5a8aa328b2f21f946d253895ebdf996901b469a5d8bea906cec5d671086774d4"} Jul 06 23:44:24.369415 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.369387 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:24.369525 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.369468 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:24.371835 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.371808 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bff359-d95f-47d8-bdc4-51c00eca4ce6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mkbr9\" (UID: \"c0bff359-d95f-47d8-bdc4-51c00eca4ce6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:24.371952 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.371908 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6245d8bc-cfa0-4153-a2ed-0a199b03606b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s8wh4\" (UID: \"6245d8bc-cfa0-4153-a2ed-0a199b03606b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:24.566161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.566099 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" Jul 06 23:44:24.607782 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.607557 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" Jul 06 23:44:24.714258 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.714156 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4"] Jul 06 23:44:24.718963 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:24.718921 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6245d8bc_cfa0_4153_a2ed_0a199b03606b.slice/crio-d1847e9ea0a27bceedfb475f5c01dcdbac0f85519a66e69301ed25c4a685b32e WatchSource:0}: Error finding container d1847e9ea0a27bceedfb475f5c01dcdbac0f85519a66e69301ed25c4a685b32e: Status 404 returned error can't find the container with id d1847e9ea0a27bceedfb475f5c01dcdbac0f85519a66e69301ed25c4a685b32e Jul 06 23:44:24.763503 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:24.763477 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9"] Jul 06 23:44:24.767799 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:24.767771 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bff359_d95f_47d8_bdc4_51c00eca4ce6.slice/crio-4d90c49e7c7a0df9b1a2d08212b9baa5edcd68cce53219ffd87e67bf949774c9 WatchSource:0}: Error finding container 4d90c49e7c7a0df9b1a2d08212b9baa5edcd68cce53219ffd87e67bf949774c9: Status 404 returned error can't find the container with id 4d90c49e7c7a0df9b1a2d08212b9baa5edcd68cce53219ffd87e67bf949774c9 Jul 06 23:44:25.253019 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:25.252990 2556 generic.go:356] "Generic (PLEG): container finished" podID="14b1ea91-76fb-47e4-b343-b3b02748c981" containerID="156aed6a16f348bf04c11e5c958d51c411edd43843b7096ee7c8d8659a9945f3" exitCode=0 Jul 06 23:44:25.253453 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:25.253078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7crt" event={"ID":"14b1ea91-76fb-47e4-b343-b3b02748c981","Type":"ContainerDied","Data":"156aed6a16f348bf04c11e5c958d51c411edd43843b7096ee7c8d8659a9945f3"} Jul 06 23:44:25.255101 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:25.255075 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" event={"ID":"6245d8bc-cfa0-4153-a2ed-0a199b03606b","Type":"ContainerStarted","Data":"75254afb0ff25c442f398e489cd2eefa6102295478efd05c4182228c3808d02b"} Jul 06 23:44:25.255225 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:25.255133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" event={"ID":"6245d8bc-cfa0-4153-a2ed-0a199b03606b","Type":"ContainerStarted","Data":"103cf233db1ec91b076faef5fd496af6ba6bf29e3df2e7360e02eb582dd04522"} Jul 06 23:44:25.255225 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:25.255161 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" event={"ID":"6245d8bc-cfa0-4153-a2ed-0a199b03606b","Type":"ContainerStarted","Data":"d1847e9ea0a27bceedfb475f5c01dcdbac0f85519a66e69301ed25c4a685b32e"} Jul 06 23:44:25.256480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:25.256454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" event={"ID":"c0bff359-d95f-47d8-bdc4-51c00eca4ce6","Type":"ContainerStarted","Data":"4d90c49e7c7a0df9b1a2d08212b9baa5edcd68cce53219ffd87e67bf949774c9"} Jul 06 23:44:26.263090 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.263055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7crt" event={"ID":"14b1ea91-76fb-47e4-b343-b3b02748c981","Type":"ContainerStarted","Data":"46980d7c5a187457295437cebb3609a70b0c559f97c962ee6c0422e18b41e7aa"} Jul 06 23:44:26.263400 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.263122 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7crt" event={"ID":"14b1ea91-76fb-47e4-b343-b3b02748c981","Type":"ContainerStarted","Data":"e1266df132659cb334004fa7965df130a878f3939876230bcb62363f9b30dce9"} Jul 06 23:44:26.266270 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.266245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" event={"ID":"6245d8bc-cfa0-4153-a2ed-0a199b03606b","Type":"ContainerStarted","Data":"2b0266e96ae66237a9159ea51c24f84d2033ef5e5a30f7a28962ec7c13bcb83b"} Jul 06 23:44:26.270515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.270493 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" event={"ID":"c0bff359-d95f-47d8-bdc4-51c00eca4ce6","Type":"ContainerStarted","Data":"f24c2c42b86ab86ac761447faaac1bc83e69bb4f607443a97f3cd5adba783d9d"} Jul 06 23:44:26.270651 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.270638 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" event={"ID":"c0bff359-d95f-47d8-bdc4-51c00eca4ce6","Type":"ContainerStarted","Data":"b21098067abde0a373591f5c1fc42c40de9836bb6e54590b56a648ea26162023"} Jul 06 23:44:26.284327 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.284287 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s7crt" podStartSLOduration=2.198267324 podStartE2EDuration="3.284271987s" totalImagesPullingTime="1.015626494s" totalInitContainerRuntime="70.378169ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:26.283233013 +0000 UTC m=+57.948408051" watchObservedRunningTime="2026-07-06 23:44:26.284271987 +0000 UTC m=+57.949447024" Jul 06 23:44:26.300092 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.300042 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s8wh4" podStartSLOduration=2.069079919 podStartE2EDuration="3.300024711s" totalImagesPullingTime="1.230944792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:26.299555057 +0000 UTC m=+57.964730096" watchObservedRunningTime="2026-07-06 23:44:26.300024711 +0000 UTC m=+57.965199750" Jul 06 23:44:26.686149 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.686119 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dc99c7475-dlpz7"] Jul 06 23:44:26.688715 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.688698 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.693250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.691790 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 23:44:26.693250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.692061 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 23:44:26.693250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.692119 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 23:44:26.693250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.692305 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 23:44:26.693250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.692061 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-oipb2umk2pq6\"" Jul 06 23:44:26.693250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.692403 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 23:44:26.693250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.692316 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vhc7q\"" Jul 06 23:44:26.701459 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.701438 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dc99c7475-dlpz7"] Jul 06 23:44:26.791770 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.791751 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd5gs\" (UniqueName: \"kubernetes.io/projected/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-kube-api-access-jd5gs\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.791874 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.791782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-grpc-tls\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.791874 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.791817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.791874 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.791835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.792005 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.791930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-tls\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.792005 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.791960 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-metrics-client-ca\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.792005 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.791983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.792116 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.792024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.892990 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.892966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd5gs\" (UniqueName: \"kubernetes.io/projected/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-kube-api-access-jd5gs\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893086 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-grpc-tls\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893086 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893040 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893086 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893261 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-tls\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893261 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-metrics-client-ca\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893261 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893127 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893261 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.893953 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.893896 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-metrics-client-ca\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.896021 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.896001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-tls\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.896116 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.896001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.896396 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.896374 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.896449 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.896389 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.896449 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.896412 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-grpc-tls\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.896515 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.896455 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:26.906621 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:26.906600 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd5gs\" (UniqueName: \"kubernetes.io/projected/20f66b77-ca63-4ec5-9cc2-2950dfad2be7-kube-api-access-jd5gs\") pod \"thanos-querier-7dc99c7475-dlpz7\" (UID: \"20f66b77-ca63-4ec5-9cc2-2950dfad2be7\") " pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:27.001034 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.000985 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:27.129701 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.129610 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dc99c7475-dlpz7"] Jul 06 23:44:27.131942 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:27.131905 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f66b77_ca63_4ec5_9cc2_2950dfad2be7.slice/crio-42395b542c92f59f3652867663882338815498277bfaff69776da6f6350864dd WatchSource:0}: Error finding container 42395b542c92f59f3652867663882338815498277bfaff69776da6f6350864dd: Status 404 returned error can't find the container with id 42395b542c92f59f3652867663882338815498277bfaff69776da6f6350864dd Jul 06 23:44:27.274661 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.274591 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" event={"ID":"20f66b77-ca63-4ec5-9cc2-2950dfad2be7","Type":"ContainerStarted","Data":"42395b542c92f59f3652867663882338815498277bfaff69776da6f6350864dd"} Jul 06 23:44:27.277068 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.277041 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" event={"ID":"c0bff359-d95f-47d8-bdc4-51c00eca4ce6","Type":"ContainerStarted","Data":"b3c4503e1cb729503dd32490f39fcb21dd0379a9ef4c9fb225d4005d6f09665f"} Jul 06 23:44:27.298101 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.298051 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mkbr9" podStartSLOduration=2.996371236 podStartE2EDuration="4.298034283s" totalImagesPullingTime="1.301663047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:27.296976616 +0000 UTC m=+58.962151677" watchObservedRunningTime="2026-07-06 23:44:27.298034283 +0000 UTC m=+58.963209368" Jul 06 23:44:27.915123 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.915091 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d96c79f7d-5tsp6"] Jul 06 23:44:27.917498 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.917478 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:27.919904 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.919874 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 23:44:27.921069 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.921045 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 23:44:27.921186 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.921084 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nsgtc\"" Jul 06 23:44:27.921186 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.921123 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 23:44:27.921328 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.921047 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fhgc9kbdqvsvg\"" Jul 06 23:44:27.921426 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.921407 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 23:44:27.928166 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:27.928145 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d96c79f7d-5tsp6"] Jul 06 23:44:28.003395 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.003374 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-client-ca-bundle\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.003519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.003407 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4gz\" (UniqueName: \"kubernetes.io/projected/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-kube-api-access-km4gz\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.003519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.003450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-audit-log\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.003519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.003496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-metrics-server-audit-profiles\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.003673 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.003518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-secret-metrics-server-tls\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.003673 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.003562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.003673 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.003589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-secret-metrics-server-client-certs\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.103967 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.103936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-secret-metrics-server-client-certs\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104079 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.103999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-client-ca-bundle\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104079 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.104024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4gz\" (UniqueName: \"kubernetes.io/projected/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-kube-api-access-km4gz\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104185 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.104089 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-audit-log\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104185 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.104124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-metrics-server-audit-profiles\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104185 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.104156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-secret-metrics-server-tls\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104349 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.104221 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104596 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.104573 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-audit-log\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.104978 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.104927 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.105302 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.105281 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-metrics-server-audit-profiles\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.107231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.107213 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-secret-metrics-server-client-certs\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.107317 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.107279 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-secret-metrics-server-tls\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.107418 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.107396 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-client-ca-bundle\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.112646 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.112627 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4gz\" (UniqueName: \"kubernetes.io/projected/4aee3d7b-3720-44b5-9fad-25a77b7cecd1-kube-api-access-km4gz\") pod \"metrics-server-5d96c79f7d-5tsp6\" (UID: \"4aee3d7b-3720-44b5-9fad-25a77b7cecd1\") " pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.228831 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.228776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:28.370229 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.370178 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d96c79f7d-5tsp6"] Jul 06 23:44:28.414155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.414125 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56d96777d-ff9zb"] Jul 06 23:44:28.420391 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.418608 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.432311 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.432288 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d96777d-ff9zb"] Jul 06 23:44:28.508085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.508015 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-trusted-ca-bundle\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.508085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.508062 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-service-ca\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.508267 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.508091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-oauth-config\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.508267 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.508164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-config\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.508267 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.508212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-serving-cert\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.508418 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.508263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-oauth-serving-cert\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.508418 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.508343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhl88\" (UniqueName: \"kubernetes.io/projected/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-kube-api-access-hhl88\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.609390 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.609354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-trusted-ca-bundle\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.609535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.609409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-service-ca\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.609535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.609445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-oauth-config\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.609535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.609495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-config\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.609535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.609531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-serving-cert\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.609743 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.609716 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-oauth-serving-cert\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.609809 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.609789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhl88\" (UniqueName: \"kubernetes.io/projected/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-kube-api-access-hhl88\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.610269 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.610224 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-service-ca\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.610638 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.610613 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-trusted-ca-bundle\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.611227 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.611177 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-oauth-serving-cert\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.611335 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.611257 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-config\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.612482 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.612465 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-serving-cert\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.612604 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.612582 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-oauth-config\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.617604 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.617582 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhl88\" (UniqueName: \"kubernetes.io/projected/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-kube-api-access-hhl88\") pod \"console-56d96777d-ff9zb\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.729837 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.729813 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:28.854546 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:28.854484 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aee3d7b_3720_44b5_9fad_25a77b7cecd1.slice/crio-24f39d9c6c519ec970bc256c2a675bf18980162947f0df3e53a38782b5f4fd4a WatchSource:0}: Error finding container 24f39d9c6c519ec970bc256c2a675bf18980162947f0df3e53a38782b5f4fd4a: Status 404 returned error can't find the container with id 24f39d9c6c519ec970bc256c2a675bf18980162947f0df3e53a38782b5f4fd4a Jul 06 23:44:28.981968 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:28.981937 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d96777d-ff9zb"] Jul 06 23:44:28.985536 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:28.985511 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4d4f6c_0f35_4723_ad70_f87ac064e97c.slice/crio-5fe8246eac01df7b6d86fd6fa0af87408b03e9ccc1d8d22673ca95a8e60f73b5 WatchSource:0}: Error finding container 5fe8246eac01df7b6d86fd6fa0af87408b03e9ccc1d8d22673ca95a8e60f73b5: Status 404 returned error can't find the container with id 5fe8246eac01df7b6d86fd6fa0af87408b03e9ccc1d8d22673ca95a8e60f73b5 Jul 06 23:44:29.285730 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:29.285690 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d96777d-ff9zb" event={"ID":"cf4d4f6c-0f35-4723-ad70-f87ac064e97c","Type":"ContainerStarted","Data":"6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9"} Jul 06 23:44:29.285897 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:29.285750 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d96777d-ff9zb" event={"ID":"cf4d4f6c-0f35-4723-ad70-f87ac064e97c","Type":"ContainerStarted","Data":"5fe8246eac01df7b6d86fd6fa0af87408b03e9ccc1d8d22673ca95a8e60f73b5"} Jul 06 23:44:29.286913 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:29.286882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" event={"ID":"4aee3d7b-3720-44b5-9fad-25a77b7cecd1","Type":"ContainerStarted","Data":"24f39d9c6c519ec970bc256c2a675bf18980162947f0df3e53a38782b5f4fd4a"} Jul 06 23:44:29.288733 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:29.288711 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" event={"ID":"20f66b77-ca63-4ec5-9cc2-2950dfad2be7","Type":"ContainerStarted","Data":"4bd834be2a753a2e1051df3b238417b0dd60eead5c3a0243f685bcbc0cddb44a"} Jul 06 23:44:29.288857 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:29.288774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" event={"ID":"20f66b77-ca63-4ec5-9cc2-2950dfad2be7","Type":"ContainerStarted","Data":"b891cd7bbb3ac38c5b635a53ded9d6068d665a7adb64185e668ed541412a20a7"} Jul 06 23:44:29.288857 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:29.288816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" event={"ID":"20f66b77-ca63-4ec5-9cc2-2950dfad2be7","Type":"ContainerStarted","Data":"3707bcd259d96798eebf79a4def3adb9d5acfc5ef313445e74d3ca45a2fa7246"} Jul 06 23:44:29.304417 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:29.304371 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56d96777d-ff9zb" podStartSLOduration=1.3043588179999999 podStartE2EDuration="1.304358818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:29.302885261 +0000 UTC m=+60.968060299" watchObservedRunningTime="2026-07-06 23:44:29.304358818 +0000 UTC m=+60.969533833" Jul 06 23:44:30.153459 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:30.153433 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45k2f" Jul 06 23:44:30.294157 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:30.294134 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" event={"ID":"20f66b77-ca63-4ec5-9cc2-2950dfad2be7","Type":"ContainerStarted","Data":"f71ba702269a2edc8047b179f9a94a9a9291176255ae42783b75a6c925fe33cf"} Jul 06 23:44:31.298906 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:31.298869 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" event={"ID":"4aee3d7b-3720-44b5-9fad-25a77b7cecd1","Type":"ContainerStarted","Data":"6ef51b84b91afc15563691bf6dd9dec82a8f7e8a9bbe99d6854714d2c329a9ae"} Jul 06 23:44:31.302248 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:31.302216 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" event={"ID":"20f66b77-ca63-4ec5-9cc2-2950dfad2be7","Type":"ContainerStarted","Data":"a804f2cf66bc2b4339463897ea0e9ca717c9a0de75ebc5eaee4a134ccf3ca38b"} Jul 06 23:44:31.302379 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:31.302290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" event={"ID":"20f66b77-ca63-4ec5-9cc2-2950dfad2be7","Type":"ContainerStarted","Data":"2b1f2f176431f1aaf7ce1b4789208bc8dcbaf38bc2ef557874bcb1ea4c0102b4"} Jul 06 23:44:31.302447 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:31.302415 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:31.319134 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:31.319096 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" podStartSLOduration=2.597988863 podStartE2EDuration="4.31908408s" totalImagesPullingTime="1.721095217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:31.318480489 +0000 UTC m=+62.983655528" watchObservedRunningTime="2026-07-06 23:44:31.31908408 +0000 UTC m=+62.984259118" Jul 06 23:44:31.343663 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:31.343629 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" podStartSLOduration=2.884690793 podStartE2EDuration="5.343615917s" totalImagesPullingTime="2.458925124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:31.342173056 +0000 UTC m=+63.007348095" watchObservedRunningTime="2026-07-06 23:44:31.343615917 +0000 UTC m=+63.008790969" Jul 06 23:44:34.658145 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.658099 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:34.658629 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.658168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:34.658629 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.658212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:34.660969 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.660946 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:44:34.661646 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.661622 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:44:34.661646 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.661644 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:44:34.670982 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.670961 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:44:34.671389 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.671356 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f-metrics-certs\") pod \"network-metrics-daemon-4gcnp\" (UID: \"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f\") " pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:34.671482 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.671394 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fce18fdc-bd9b-4997-8937-d927ec259001-original-pull-secret\") pod \"global-pull-secret-syncer-6dxdx\" (UID: \"fce18fdc-bd9b-4997-8937-d927ec259001\") " pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:34.681121 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.681096 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwxd\" (UniqueName: \"kubernetes.io/projected/bfada76e-ae0e-47fa-b3e8-cc16d300476c-kube-api-access-pfwxd\") pod \"network-check-target-kgtsk\" (UID: \"bfada76e-ae0e-47fa-b3e8-cc16d300476c\") " pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:34.704212 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.700420 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m52g\"" Jul 06 23:44:34.704212 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.701489 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dxdx" Jul 06 23:44:34.709679 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.706076 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xv6vb\"" Jul 06 23:44:34.709679 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.706326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:34.714487 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.714465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gcnp" Jul 06 23:44:34.853417 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:34.853395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4gcnp"] Jul 06 23:44:34.855871 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:34.855836 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e6a5df_1ecd_4aeb_90d9_b07ea0fbd13f.slice/crio-59018fa01fb8b434f5d566f76f5f27a2f85a0432904dceb334276ce08fad760c WatchSource:0}: Error finding container 59018fa01fb8b434f5d566f76f5f27a2f85a0432904dceb334276ce08fad760c: Status 404 returned error can't find the container with id 59018fa01fb8b434f5d566f76f5f27a2f85a0432904dceb334276ce08fad760c Jul 06 23:44:35.078383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:35.078357 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgtsk"] Jul 06 23:44:35.080814 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:35.080760 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6dxdx"] Jul 06 23:44:35.081086 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:35.081064 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfada76e_ae0e_47fa_b3e8_cc16d300476c.slice/crio-47aca868bea339c6ab4f7dc186b7e8f824f24a454687641147102b07d976220d WatchSource:0}: Error finding container 47aca868bea339c6ab4f7dc186b7e8f824f24a454687641147102b07d976220d: Status 404 returned error can't find the container with id 47aca868bea339c6ab4f7dc186b7e8f824f24a454687641147102b07d976220d Jul 06 23:44:35.084469 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:44:35.084441 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce18fdc_bd9b_4997_8937_d927ec259001.slice/crio-d9df7358de278243974ed73821ea702e9f532a628d78aef1d2cea24f3f9000dd WatchSource:0}: Error finding container d9df7358de278243974ed73821ea702e9f532a628d78aef1d2cea24f3f9000dd: Status 404 returned error can't find the container with id d9df7358de278243974ed73821ea702e9f532a628d78aef1d2cea24f3f9000dd Jul 06 23:44:35.318172 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:35.318142 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gcnp" event={"ID":"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f","Type":"ContainerStarted","Data":"59018fa01fb8b434f5d566f76f5f27a2f85a0432904dceb334276ce08fad760c"} Jul 06 23:44:35.319434 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:35.319409 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgtsk" event={"ID":"bfada76e-ae0e-47fa-b3e8-cc16d300476c","Type":"ContainerStarted","Data":"47aca868bea339c6ab4f7dc186b7e8f824f24a454687641147102b07d976220d"} Jul 06 23:44:35.320879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:35.320856 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6dxdx" event={"ID":"fce18fdc-bd9b-4997-8937-d927ec259001","Type":"ContainerStarted","Data":"d9df7358de278243974ed73821ea702e9f532a628d78aef1d2cea24f3f9000dd"} Jul 06 23:44:36.329871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:36.329002 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gcnp" event={"ID":"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f","Type":"ContainerStarted","Data":"3dd5983bcc80acb3287c8e0b21aba34f55ae1bffb3dc3e100114bc6e3019f098"} Jul 06 23:44:36.329871 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:36.329063 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gcnp" event={"ID":"97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f","Type":"ContainerStarted","Data":"3e8bf82f706b77bfb68c91fcda2db6f6a6213a5a595dd0aa68aa8ceaa66163ca"} Jul 06 23:44:36.362657 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:36.362603 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4gcnp" podStartSLOduration=66.319283505 podStartE2EDuration="1m7.36258064s" totalImagesPullingTime="1.043297135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:36.360163235 +0000 UTC m=+68.025338274" watchObservedRunningTime="2026-07-06 23:44:36.36258064 +0000 UTC m=+68.027755677" Jul 06 23:44:37.314367 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:37.313357 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dc99c7475-dlpz7" Jul 06 23:44:38.730311 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:38.730262 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:38.730768 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:38.730349 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:38.736273 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:38.736215 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:39.350651 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:39.350622 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:44:39.392488 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:39.392455 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655bc5c784-wst2j"] Jul 06 23:44:40.351864 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:40.351775 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgtsk" event={"ID":"bfada76e-ae0e-47fa-b3e8-cc16d300476c","Type":"ContainerStarted","Data":"cec73532fb8422112324b31d5502ae518a625fea88a8f2e07ab4229062d0f502"} Jul 06 23:44:40.352351 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:40.351898 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:44:40.353604 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:40.353574 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6dxdx" event={"ID":"fce18fdc-bd9b-4997-8937-d927ec259001","Type":"ContainerStarted","Data":"6e4d29fbbbd46f77f3d9f9b290167bc47cc24309efc0344e0d5e61925b76d3d2"} Jul 06 23:44:40.368102 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:40.368050 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kgtsk" podStartSLOduration=66.555480393 podStartE2EDuration="1m11.368034655s" totalImagesPullingTime="4.812554262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:40.366473213 +0000 UTC m=+72.031648265" watchObservedRunningTime="2026-07-06 23:44:40.368034655 +0000 UTC m=+72.033209693" Jul 06 23:44:40.381233 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:40.381133 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6dxdx" podStartSLOduration=66.565126818 podStartE2EDuration="1m11.381116546s" totalImagesPullingTime="4.815989728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:40.380892793 +0000 UTC m=+72.046067834" watchObservedRunningTime="2026-07-06 23:44:40.381116546 +0000 UTC m=+72.046291586" Jul 06 23:44:48.229778 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:48.229746 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:44:48.230132 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:44:48.229803 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:45:04.421264 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.421060 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-655bc5c784-wst2j" podUID="de90b3e7-c8b0-4dc7-820b-39f8ce57601f" containerName="console" containerID="cri-o://f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01" gracePeriod=15 Jul 06 23:45:04.651698 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.651669 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:45:04.765519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765463 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kxzt\" (UniqueName: \"kubernetes.io/projected/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-kube-api-access-5kxzt\") pod \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " Jul 06 23:45:04.765519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765499 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-oauth-config\") pod \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " Jul 06 23:45:04.765669 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765529 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-oauth-serving-cert\") pod \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " Jul 06 23:45:04.765669 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765581 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-serving-cert\") pod \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " Jul 06 23:45:04.765669 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765608 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-trusted-ca-bundle\") pod \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " Jul 06 23:45:04.765669 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765640 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-service-ca\") pod \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " Jul 06 23:45:04.765863 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765685 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-config\") pod \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\" (UID: \"de90b3e7-c8b0-4dc7-820b-39f8ce57601f\") " Jul 06 23:45:04.766045 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.765993 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "de90b3e7-c8b0-4dc7-820b-39f8ce57601f" (UID: "de90b3e7-c8b0-4dc7-820b-39f8ce57601f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:04.766171 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.766108 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-service-ca" (OuterVolumeSpecName: "service-ca") pod "de90b3e7-c8b0-4dc7-820b-39f8ce57601f" (UID: "de90b3e7-c8b0-4dc7-820b-39f8ce57601f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:04.766171 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.766132 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "de90b3e7-c8b0-4dc7-820b-39f8ce57601f" (UID: "de90b3e7-c8b0-4dc7-820b-39f8ce57601f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:04.766382 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.766244 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-config" (OuterVolumeSpecName: "console-config") pod "de90b3e7-c8b0-4dc7-820b-39f8ce57601f" (UID: "de90b3e7-c8b0-4dc7-820b-39f8ce57601f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:04.767891 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.767868 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-kube-api-access-5kxzt" (OuterVolumeSpecName: "kube-api-access-5kxzt") pod "de90b3e7-c8b0-4dc7-820b-39f8ce57601f" (UID: "de90b3e7-c8b0-4dc7-820b-39f8ce57601f"). InnerVolumeSpecName "kube-api-access-5kxzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:45:04.767891 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.767873 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "de90b3e7-c8b0-4dc7-820b-39f8ce57601f" (UID: "de90b3e7-c8b0-4dc7-820b-39f8ce57601f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:45:04.768005 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.767931 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "de90b3e7-c8b0-4dc7-820b-39f8ce57601f" (UID: "de90b3e7-c8b0-4dc7-820b-39f8ce57601f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:45:04.866062 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.866038 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:45:04.866161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.866062 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kxzt\" (UniqueName: \"kubernetes.io/projected/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-kube-api-access-5kxzt\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:45:04.866161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.866077 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-oauth-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:45:04.866161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.866089 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-oauth-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:45:04.866161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.866101 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-console-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:45:04.866161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.866113 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-trusted-ca-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:45:04.866161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:04.866125 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de90b3e7-c8b0-4dc7-820b-39f8ce57601f-service-ca\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:45:05.454314 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.454283 2556 generic.go:356] "Generic (PLEG): container finished" podID="de90b3e7-c8b0-4dc7-820b-39f8ce57601f" containerID="f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01" exitCode=0 Jul 06 23:45:05.454727 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.454349 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655bc5c784-wst2j" Jul 06 23:45:05.454727 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.454378 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655bc5c784-wst2j" event={"ID":"de90b3e7-c8b0-4dc7-820b-39f8ce57601f","Type":"ContainerDied","Data":"f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01"} Jul 06 23:45:05.454727 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.454440 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655bc5c784-wst2j" event={"ID":"de90b3e7-c8b0-4dc7-820b-39f8ce57601f","Type":"ContainerDied","Data":"746729bcc86c9d3d88154b36f5ac02b9d1bfa0e3e7d49f6660ac282098a88f0d"} Jul 06 23:45:05.454727 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.454465 2556 scope.go:117] "RemoveContainer" containerID="f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01" Jul 06 23:45:05.464119 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.464095 2556 scope.go:117] "RemoveContainer" containerID="f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01" Jul 06 23:45:05.464447 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:45:05.464427 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01\": container with ID starting with f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01 not found: ID does not exist" containerID="f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01" Jul 06 23:45:05.464497 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.464456 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01"} err="failed to get container status \"f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01\": rpc error: code = NotFound desc = could not find container \"f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01\": container with ID starting with f1fb458cb7be733aa85a1f932a2884e61d50850eaccfa73cfa12c9e8fd056d01 not found: ID does not exist" Jul 06 23:45:05.470710 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.470683 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655bc5c784-wst2j"] Jul 06 23:45:05.474611 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:05.474588 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-655bc5c784-wst2j"] Jul 06 23:45:06.862475 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:06.862440 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de90b3e7-c8b0-4dc7-820b-39f8ce57601f" path="/var/lib/kubelet/pods/de90b3e7-c8b0-4dc7-820b-39f8ce57601f/volumes" Jul 06 23:45:08.234269 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:08.234240 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:45:08.238101 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:08.238073 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d96c79f7d-5tsp6" Jul 06 23:45:11.365406 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:11.364828 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kgtsk" Jul 06 23:45:47.882137 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.882106 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b4d978b59-7rh8d"] Jul 06 23:45:47.882656 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.882379 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de90b3e7-c8b0-4dc7-820b-39f8ce57601f" containerName="console" Jul 06 23:45:47.882656 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.882394 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="de90b3e7-c8b0-4dc7-820b-39f8ce57601f" containerName="console" Jul 06 23:45:47.882656 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.882457 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="de90b3e7-c8b0-4dc7-820b-39f8ce57601f" containerName="console" Jul 06 23:45:47.885540 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.885524 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.887826 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.887805 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 23:45:47.887945 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.887922 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 23:45:47.888083 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.888004 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 23:45:47.888340 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.888317 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ks4tg\"" Jul 06 23:45:47.888340 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.888333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 23:45:47.888443 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.888341 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 23:45:47.893171 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.893011 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 23:45:47.898348 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.898325 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b4d978b59-7rh8d"] Jul 06 23:45:47.961672 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961650 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5ldz\" (UniqueName: \"kubernetes.io/projected/8aafafe8-525c-4837-934f-d10005ad5f84-kube-api-access-g5ldz\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.961758 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961681 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.961758 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-serving-certs-ca-bundle\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.961758 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-federate-client-tls\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.961854 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-metrics-client-ca\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.961885 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-secret-telemeter-client\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.961885 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-telemeter-client-tls\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:47.961944 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:47.961896 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062524 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5ldz\" (UniqueName: \"kubernetes.io/projected/8aafafe8-525c-4837-934f-d10005ad5f84-kube-api-access-g5ldz\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062605 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062605 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-serving-certs-ca-bundle\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062605 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-federate-client-tls\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062748 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-metrics-client-ca\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062748 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062654 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-secret-telemeter-client\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062748 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-telemeter-client-tls\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.062748 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.062719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.064684 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.064664 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-serving-certs-ca-bundle\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.064955 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.064936 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-metrics-client-ca\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.065090 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.065068 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aafafe8-525c-4837-934f-d10005ad5f84-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.066390 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.066371 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.066543 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.066516 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-federate-client-tls\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.066771 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.066755 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-telemeter-client-tls\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.066850 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.066832 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8aafafe8-525c-4837-934f-d10005ad5f84-secret-telemeter-client\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.070569 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.070552 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5ldz\" (UniqueName: \"kubernetes.io/projected/8aafafe8-525c-4837-934f-d10005ad5f84-kube-api-access-g5ldz\") pod \"telemeter-client-5b4d978b59-7rh8d\" (UID: \"8aafafe8-525c-4837-934f-d10005ad5f84\") " pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.195277 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.195259 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" Jul 06 23:45:48.323276 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.323240 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b4d978b59-7rh8d"] Jul 06 23:45:48.326688 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:45:48.326662 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aafafe8_525c_4837_934f_d10005ad5f84.slice/crio-fcd2bbc75121ca5b03c8da04bd4f2dba03dae3700a0ba0c3c1b088d50ac2d773 WatchSource:0}: Error finding container fcd2bbc75121ca5b03c8da04bd4f2dba03dae3700a0ba0c3c1b088d50ac2d773: Status 404 returned error can't find the container with id fcd2bbc75121ca5b03c8da04bd4f2dba03dae3700a0ba0c3c1b088d50ac2d773 Jul 06 23:45:48.608886 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:48.608820 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" event={"ID":"8aafafe8-525c-4837-934f-d10005ad5f84","Type":"ContainerStarted","Data":"fcd2bbc75121ca5b03c8da04bd4f2dba03dae3700a0ba0c3c1b088d50ac2d773"} Jul 06 23:45:50.617786 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:50.617724 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" event={"ID":"8aafafe8-525c-4837-934f-d10005ad5f84","Type":"ContainerStarted","Data":"efb2da0131be91ecd4b3895aebb15f4e4317f36c98180a313c800c79662a42c6"} Jul 06 23:45:51.623092 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:51.623028 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" event={"ID":"8aafafe8-525c-4837-934f-d10005ad5f84","Type":"ContainerStarted","Data":"bf7280c401d949235e765b27922cbd693743af855f76b33ac7902c78fcc0f34d"} Jul 06 23:45:51.623092 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:51.623081 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" event={"ID":"8aafafe8-525c-4837-934f-d10005ad5f84","Type":"ContainerStarted","Data":"9191f217511ba618a473f25df9c4e09320fe0526084988d37405737264b99f75"} Jul 06 23:45:51.645592 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:51.645547 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b4d978b59-7rh8d" podStartSLOduration=1.72219254 podStartE2EDuration="4.645530059s" totalImagesPullingTime="2.923337519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:45:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:45:51.642983528 +0000 UTC m=+143.308158578" watchObservedRunningTime="2026-07-06 23:45:51.645530059 +0000 UTC m=+143.310705099" Jul 06 23:45:52.349056 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.349029 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcdfdb78d-878s4"] Jul 06 23:45:52.352310 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.352293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.362085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.362061 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcdfdb78d-878s4"] Jul 06 23:45:52.393823 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.393798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fscxq\" (UniqueName: \"kubernetes.io/projected/6d0024fb-d759-4505-ac9e-d360dc808141-kube-api-access-fscxq\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.393915 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.393834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-oauth-serving-cert\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.393915 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.393863 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-service-ca\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.394009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.393933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-oauth-config\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.394009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.393961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-console-config\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.394009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.393987 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-trusted-ca-bundle\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.394009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.394008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-serving-cert\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.494294 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.494270 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-service-ca\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.494394 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.494298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-oauth-config\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.494394 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.494317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-console-config\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.494394 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.494341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-trusted-ca-bundle\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.494394 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.494360 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-serving-cert\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.494617 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.494594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fscxq\" (UniqueName: \"kubernetes.io/projected/6d0024fb-d759-4505-ac9e-d360dc808141-kube-api-access-fscxq\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.494696 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.494641 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-oauth-serving-cert\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.495060 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.495039 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-service-ca\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.495331 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.495316 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-trusted-ca-bundle\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.495377 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.495331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-console-config\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.495544 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.495522 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-oauth-serving-cert\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.496885 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.496858 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-oauth-config\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.496988 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.496933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-serving-cert\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.502034 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.502015 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fscxq\" (UniqueName: \"kubernetes.io/projected/6d0024fb-d759-4505-ac9e-d360dc808141-kube-api-access-fscxq\") pod \"console-7bcdfdb78d-878s4\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.661469 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.661444 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:45:52.787643 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:52.787618 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcdfdb78d-878s4"] Jul 06 23:45:52.790030 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:45:52.790007 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0024fb_d759_4505_ac9e_d360dc808141.slice/crio-c995da598547609028c7a33d639439b785008718ee84b53ca17e2f5bd7d17ff1 WatchSource:0}: Error finding container c995da598547609028c7a33d639439b785008718ee84b53ca17e2f5bd7d17ff1: Status 404 returned error can't find the container with id c995da598547609028c7a33d639439b785008718ee84b53ca17e2f5bd7d17ff1 Jul 06 23:45:53.631335 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:53.631295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcdfdb78d-878s4" event={"ID":"6d0024fb-d759-4505-ac9e-d360dc808141","Type":"ContainerStarted","Data":"6a62f0b436218021c6509a364dccd95dbfa2f942bb72b98af3cf4a165aa17a1d"} Jul 06 23:45:53.631552 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:53.631349 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcdfdb78d-878s4" event={"ID":"6d0024fb-d759-4505-ac9e-d360dc808141","Type":"ContainerStarted","Data":"c995da598547609028c7a33d639439b785008718ee84b53ca17e2f5bd7d17ff1"} Jul 06 23:45:53.649379 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:45:53.649331 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcdfdb78d-878s4" podStartSLOduration=1.649316025 podStartE2EDuration="1.649316025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:45:53.648438963 +0000 UTC m=+145.313614004" watchObservedRunningTime="2026-07-06 23:45:53.649316025 +0000 UTC m=+145.314491120" Jul 06 23:46:02.579051 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.579018 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcdfdb78d-878s4"] Jul 06 23:46:02.613983 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.613954 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-696fbccc7d-klwgq"] Jul 06 23:46:02.617233 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.617218 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.626996 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.626978 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-696fbccc7d-klwgq"] Jul 06 23:46:02.661646 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.661626 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:46:02.664031 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.664011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-serving-cert\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.664094 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.664044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-service-ca\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.664094 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.664061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47mmm\" (UniqueName: \"kubernetes.io/projected/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-kube-api-access-47mmm\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.664171 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.664090 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-oauth-config\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.664171 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.664149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-config\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.664257 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.664170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-oauth-serving-cert\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.664257 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.664251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-trusted-ca-bundle\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.764672 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.764646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-trusted-ca-bundle\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.764781 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.764680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-serving-cert\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.764781 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.764698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-service-ca\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.764781 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.764714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47mmm\" (UniqueName: \"kubernetes.io/projected/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-kube-api-access-47mmm\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.764781 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.764739 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-oauth-config\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.764989 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.764801 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-config\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.764989 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.764825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-oauth-serving-cert\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.765571 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.765531 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-service-ca\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.765681 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.765601 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-trusted-ca-bundle\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.765681 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.765611 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-config\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.765802 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.765694 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-oauth-serving-cert\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.767221 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.767167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-serving-cert\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.767300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.767225 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-oauth-config\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.772144 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.772126 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47mmm\" (UniqueName: \"kubernetes.io/projected/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-kube-api-access-47mmm\") pod \"console-696fbccc7d-klwgq\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:02.926305 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:02.926275 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:03.053354 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:03.053331 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-696fbccc7d-klwgq"] Jul 06 23:46:03.055756 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:46:03.055723 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d1c6e2_9b01_4a8c_9116_18dbcb530c39.slice/crio-b86d6b258f963958cefe7144b0b7ff7b38f746c10e505f001646fb45c44e3b22 WatchSource:0}: Error finding container b86d6b258f963958cefe7144b0b7ff7b38f746c10e505f001646fb45c44e3b22: Status 404 returned error can't find the container with id b86d6b258f963958cefe7144b0b7ff7b38f746c10e505f001646fb45c44e3b22 Jul 06 23:46:03.669869 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:03.669836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696fbccc7d-klwgq" event={"ID":"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39","Type":"ContainerStarted","Data":"ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153"} Jul 06 23:46:03.670324 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:03.669889 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696fbccc7d-klwgq" event={"ID":"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39","Type":"ContainerStarted","Data":"b86d6b258f963958cefe7144b0b7ff7b38f746c10e505f001646fb45c44e3b22"} Jul 06 23:46:03.687349 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:03.687308 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-696fbccc7d-klwgq" podStartSLOduration=1.6872933319999999 podStartE2EDuration="1.687293332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:46:03.685280147 +0000 UTC m=+155.350455199" watchObservedRunningTime="2026-07-06 23:46:03.687293332 +0000 UTC m=+155.352468369" Jul 06 23:46:12.927294 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:12.927253 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:12.927760 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:12.927315 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:12.932034 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:12.932012 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:13.711066 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:13.711039 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:46:13.753087 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:13.752337 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d96777d-ff9zb"] Jul 06 23:46:27.598846 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.598789 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bcdfdb78d-878s4" podUID="6d0024fb-d759-4505-ac9e-d360dc808141" containerName="console" containerID="cri-o://6a62f0b436218021c6509a364dccd95dbfa2f942bb72b98af3cf4a165aa17a1d" gracePeriod=15 Jul 06 23:46:27.760500 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.760468 2556 generic.go:356] "Generic (PLEG): container finished" podID="6d0024fb-d759-4505-ac9e-d360dc808141" containerID="6a62f0b436218021c6509a364dccd95dbfa2f942bb72b98af3cf4a165aa17a1d" exitCode=0 Jul 06 23:46:27.760649 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.760548 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcdfdb78d-878s4" event={"ID":"6d0024fb-d759-4505-ac9e-d360dc808141","Type":"ContainerDied","Data":"6a62f0b436218021c6509a364dccd95dbfa2f942bb72b98af3cf4a165aa17a1d"} Jul 06 23:46:27.841306 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.841287 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:46:27.954970 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.954943 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-serving-cert\") pod \"6d0024fb-d759-4505-ac9e-d360dc808141\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " Jul 06 23:46:27.955110 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.954977 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-service-ca\") pod \"6d0024fb-d759-4505-ac9e-d360dc808141\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " Jul 06 23:46:27.955110 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955001 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-oauth-config\") pod \"6d0024fb-d759-4505-ac9e-d360dc808141\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " Jul 06 23:46:27.955110 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955027 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fscxq\" (UniqueName: \"kubernetes.io/projected/6d0024fb-d759-4505-ac9e-d360dc808141-kube-api-access-fscxq\") pod \"6d0024fb-d759-4505-ac9e-d360dc808141\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " Jul 06 23:46:27.955110 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955083 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-oauth-serving-cert\") pod \"6d0024fb-d759-4505-ac9e-d360dc808141\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " Jul 06 23:46:27.955321 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955118 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-console-config\") pod \"6d0024fb-d759-4505-ac9e-d360dc808141\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " Jul 06 23:46:27.955321 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955146 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-trusted-ca-bundle\") pod \"6d0024fb-d759-4505-ac9e-d360dc808141\" (UID: \"6d0024fb-d759-4505-ac9e-d360dc808141\") " Jul 06 23:46:27.956061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955772 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6d0024fb-d759-4505-ac9e-d360dc808141" (UID: "6d0024fb-d759-4505-ac9e-d360dc808141"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:27.956061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955878 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d0024fb-d759-4505-ac9e-d360dc808141" (UID: "6d0024fb-d759-4505-ac9e-d360dc808141"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:27.956061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.955898 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d0024fb-d759-4505-ac9e-d360dc808141" (UID: "6d0024fb-d759-4505-ac9e-d360dc808141"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:27.956061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.956020 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-console-config" (OuterVolumeSpecName: "console-config") pod "6d0024fb-d759-4505-ac9e-d360dc808141" (UID: "6d0024fb-d759-4505-ac9e-d360dc808141"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:27.956374 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.956296 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-service-ca\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:27.956374 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.956319 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-oauth-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:27.956374 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.956345 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-console-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:27.956521 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.956392 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d0024fb-d759-4505-ac9e-d360dc808141-trusted-ca-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:27.961362 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.958092 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0024fb-d759-4505-ac9e-d360dc808141-kube-api-access-fscxq" (OuterVolumeSpecName: "kube-api-access-fscxq") pod "6d0024fb-d759-4505-ac9e-d360dc808141" (UID: "6d0024fb-d759-4505-ac9e-d360dc808141"). InnerVolumeSpecName "kube-api-access-fscxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:46:27.961362 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.958168 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d0024fb-d759-4505-ac9e-d360dc808141" (UID: "6d0024fb-d759-4505-ac9e-d360dc808141"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:46:27.961909 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:27.961887 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d0024fb-d759-4505-ac9e-d360dc808141" (UID: "6d0024fb-d759-4505-ac9e-d360dc808141"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:46:28.057524 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.057500 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:28.057524 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.057523 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d0024fb-d759-4505-ac9e-d360dc808141-console-oauth-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:28.057657 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.057533 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fscxq\" (UniqueName: \"kubernetes.io/projected/6d0024fb-d759-4505-ac9e-d360dc808141-kube-api-access-fscxq\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:28.764407 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.764373 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcdfdb78d-878s4" event={"ID":"6d0024fb-d759-4505-ac9e-d360dc808141","Type":"ContainerDied","Data":"c995da598547609028c7a33d639439b785008718ee84b53ca17e2f5bd7d17ff1"} Jul 06 23:46:28.764407 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.764400 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcdfdb78d-878s4" Jul 06 23:46:28.764916 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.764453 2556 scope.go:117] "RemoveContainer" containerID="6a62f0b436218021c6509a364dccd95dbfa2f942bb72b98af3cf4a165aa17a1d" Jul 06 23:46:28.785668 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.785641 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcdfdb78d-878s4"] Jul 06 23:46:28.788732 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.788712 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcdfdb78d-878s4"] Jul 06 23:46:28.862575 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:28.862545 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d0024fb-d759-4505-ac9e-d360dc808141" path="/var/lib/kubelet/pods/6d0024fb-d759-4505-ac9e-d360dc808141/volumes" Jul 06 23:46:38.784756 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:38.784712 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56d96777d-ff9zb" podUID="cf4d4f6c-0f35-4723-ad70-f87ac064e97c" containerName="console" containerID="cri-o://6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9" gracePeriod=15 Jul 06 23:46:39.021263 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.021240 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:46:39.143676 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.143586 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-config\") pod \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " Jul 06 23:46:39.143676 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.143633 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-oauth-config\") pod \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " Jul 06 23:46:39.143878 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.143685 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-oauth-serving-cert\") pod \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " Jul 06 23:46:39.143878 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.143735 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-trusted-ca-bundle\") pod \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " Jul 06 23:46:39.143878 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.143762 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-service-ca\") pod \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " Jul 06 23:46:39.143878 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.143790 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhl88\" (UniqueName: \"kubernetes.io/projected/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-kube-api-access-hhl88\") pod \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " Jul 06 23:46:39.143878 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.143822 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-serving-cert\") pod \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\" (UID: \"cf4d4f6c-0f35-4723-ad70-f87ac064e97c\") " Jul 06 23:46:39.144122 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.144066 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-config" (OuterVolumeSpecName: "console-config") pod "cf4d4f6c-0f35-4723-ad70-f87ac064e97c" (UID: "cf4d4f6c-0f35-4723-ad70-f87ac064e97c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:39.144252 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.144226 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:39.144323 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.144265 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf4d4f6c-0f35-4723-ad70-f87ac064e97c" (UID: "cf4d4f6c-0f35-4723-ad70-f87ac064e97c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:39.144397 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.144370 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf4d4f6c-0f35-4723-ad70-f87ac064e97c" (UID: "cf4d4f6c-0f35-4723-ad70-f87ac064e97c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:39.144480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.144453 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf4d4f6c-0f35-4723-ad70-f87ac064e97c" (UID: "cf4d4f6c-0f35-4723-ad70-f87ac064e97c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:46:39.146167 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.146143 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf4d4f6c-0f35-4723-ad70-f87ac064e97c" (UID: "cf4d4f6c-0f35-4723-ad70-f87ac064e97c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:46:39.146270 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.146163 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-kube-api-access-hhl88" (OuterVolumeSpecName: "kube-api-access-hhl88") pod "cf4d4f6c-0f35-4723-ad70-f87ac064e97c" (UID: "cf4d4f6c-0f35-4723-ad70-f87ac064e97c"). InnerVolumeSpecName "kube-api-access-hhl88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:46:39.146270 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.146176 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf4d4f6c-0f35-4723-ad70-f87ac064e97c" (UID: "cf4d4f6c-0f35-4723-ad70-f87ac064e97c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:46:39.245313 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.245282 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-oauth-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:39.245313 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.245304 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-oauth-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:39.245313 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.245314 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-trusted-ca-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:39.245537 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.245323 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-service-ca\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:39.245537 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.245333 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhl88\" (UniqueName: \"kubernetes.io/projected/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-kube-api-access-hhl88\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:39.245537 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.245342 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4d4f6c-0f35-4723-ad70-f87ac064e97c-console-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:46:39.805182 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.805147 2556 generic.go:356] "Generic (PLEG): container finished" podID="cf4d4f6c-0f35-4723-ad70-f87ac064e97c" containerID="6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9" exitCode=0 Jul 06 23:46:39.805627 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.805187 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d96777d-ff9zb" event={"ID":"cf4d4f6c-0f35-4723-ad70-f87ac064e97c","Type":"ContainerDied","Data":"6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9"} Jul 06 23:46:39.805627 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.805216 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d96777d-ff9zb" Jul 06 23:46:39.805627 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.805247 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d96777d-ff9zb" event={"ID":"cf4d4f6c-0f35-4723-ad70-f87ac064e97c","Type":"ContainerDied","Data":"5fe8246eac01df7b6d86fd6fa0af87408b03e9ccc1d8d22673ca95a8e60f73b5"} Jul 06 23:46:39.805627 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.805268 2556 scope.go:117] "RemoveContainer" containerID="6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9" Jul 06 23:46:39.813841 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.813826 2556 scope.go:117] "RemoveContainer" containerID="6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9" Jul 06 23:46:39.814097 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:46:39.814080 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9\": container with ID starting with 6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9 not found: ID does not exist" containerID="6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9" Jul 06 23:46:39.814143 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.814104 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9"} err="failed to get container status \"6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9\": rpc error: code = NotFound desc = could not find container \"6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9\": container with ID starting with 6f529f22e9b7ab49bd333f3b84e7f7d56f67d0240b21516a71c4157dc5b162f9 not found: ID does not exist" Jul 06 23:46:39.826042 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.826017 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d96777d-ff9zb"] Jul 06 23:46:39.829860 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:39.829839 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56d96777d-ff9zb"] Jul 06 23:46:40.861686 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:46:40.861655 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4d4f6c-0f35-4723-ad70-f87ac064e97c" path="/var/lib/kubelet/pods/cf4d4f6c-0f35-4723-ad70-f87ac064e97c/volumes" Jul 06 23:47:09.567866 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.567827 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm"] Jul 06 23:47:09.568480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.568162 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d0024fb-d759-4505-ac9e-d360dc808141" containerName="console" Jul 06 23:47:09.568480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.568176 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d0024fb-d759-4505-ac9e-d360dc808141" containerName="console" Jul 06 23:47:09.568480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.568184 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4d4f6c-0f35-4723-ad70-f87ac064e97c" containerName="console" Jul 06 23:47:09.568480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.568206 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4d4f6c-0f35-4723-ad70-f87ac064e97c" containerName="console" Jul 06 23:47:09.568480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.568277 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4d4f6c-0f35-4723-ad70-f87ac064e97c" containerName="console" Jul 06 23:47:09.568480 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.568288 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d0024fb-d759-4505-ac9e-d360dc808141" containerName="console" Jul 06 23:47:09.571338 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.571320 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.574154 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.574129 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c8v96\"" Jul 06 23:47:09.574294 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.574165 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:47:09.575114 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.575096 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:47:09.581111 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.581083 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm"] Jul 06 23:47:09.667032 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.667007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcgmv\" (UniqueName: \"kubernetes.io/projected/d76a07f2-0eb5-4177-a66f-9a094ce6facb-kube-api-access-lcgmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.667144 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.667059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.667144 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.667125 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.767529 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.767500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcgmv\" (UniqueName: \"kubernetes.io/projected/d76a07f2-0eb5-4177-a66f-9a094ce6facb-kube-api-access-lcgmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.767622 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.767559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.767622 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.767596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.767920 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.767898 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.767957 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.767935 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.775930 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.775899 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcgmv\" (UniqueName: \"kubernetes.io/projected/d76a07f2-0eb5-4177-a66f-9a094ce6facb-kube-api-access-lcgmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:09.882485 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:09.882430 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:10.011637 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:10.011615 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm"] Jul 06 23:47:10.014344 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:10.014319 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76a07f2_0eb5_4177_a66f_9a094ce6facb.slice/crio-b9ea14e9331f22272d97ea14738e027b6cf7448edf6cc233f5d947c407d89dc1 WatchSource:0}: Error finding container b9ea14e9331f22272d97ea14738e027b6cf7448edf6cc233f5d947c407d89dc1: Status 404 returned error can't find the container with id b9ea14e9331f22272d97ea14738e027b6cf7448edf6cc233f5d947c407d89dc1 Jul 06 23:47:10.916533 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:10.916496 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" event={"ID":"d76a07f2-0eb5-4177-a66f-9a094ce6facb","Type":"ContainerStarted","Data":"b9ea14e9331f22272d97ea14738e027b6cf7448edf6cc233f5d947c407d89dc1"} Jul 06 23:47:16.942458 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:16.942425 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerID="ba3e1644b02ec0bcef2cc60f0c5b80eaaef007b750db22f7bf6af25d6906617b" exitCode=0 Jul 06 23:47:16.942847 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:16.942519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" event={"ID":"d76a07f2-0eb5-4177-a66f-9a094ce6facb","Type":"ContainerDied","Data":"ba3e1644b02ec0bcef2cc60f0c5b80eaaef007b750db22f7bf6af25d6906617b"} Jul 06 23:47:18.951185 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:18.951157 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerID="ea73033aee32a9ca3b38900074a290d316e912414fa39f9ce0190a83eba73254" exitCode=0 Jul 06 23:47:18.951487 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:18.951231 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" event={"ID":"d76a07f2-0eb5-4177-a66f-9a094ce6facb","Type":"ContainerDied","Data":"ea73033aee32a9ca3b38900074a290d316e912414fa39f9ce0190a83eba73254"} Jul 06 23:47:26.989231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:26.989186 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerID="9cddd750a0708d6fa86f205d943c67798cae8d28d4af421425d3aac1a3130e51" exitCode=0 Jul 06 23:47:26.989632 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:26.989261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" event={"ID":"d76a07f2-0eb5-4177-a66f-9a094ce6facb","Type":"ContainerDied","Data":"9cddd750a0708d6fa86f205d943c67798cae8d28d4af421425d3aac1a3130e51"} Jul 06 23:47:28.169260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.169236 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:28.210020 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.209994 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcgmv\" (UniqueName: \"kubernetes.io/projected/d76a07f2-0eb5-4177-a66f-9a094ce6facb-kube-api-access-lcgmv\") pod \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " Jul 06 23:47:28.210135 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.210026 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-bundle\") pod \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " Jul 06 23:47:28.210135 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.210046 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-util\") pod \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\" (UID: \"d76a07f2-0eb5-4177-a66f-9a094ce6facb\") " Jul 06 23:47:28.210659 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.210629 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-bundle" (OuterVolumeSpecName: "bundle") pod "d76a07f2-0eb5-4177-a66f-9a094ce6facb" (UID: "d76a07f2-0eb5-4177-a66f-9a094ce6facb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:28.212143 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.212118 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76a07f2-0eb5-4177-a66f-9a094ce6facb-kube-api-access-lcgmv" (OuterVolumeSpecName: "kube-api-access-lcgmv") pod "d76a07f2-0eb5-4177-a66f-9a094ce6facb" (UID: "d76a07f2-0eb5-4177-a66f-9a094ce6facb"). InnerVolumeSpecName "kube-api-access-lcgmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:47:28.214337 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.214316 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-util" (OuterVolumeSpecName: "util") pod "d76a07f2-0eb5-4177-a66f-9a094ce6facb" (UID: "d76a07f2-0eb5-4177-a66f-9a094ce6facb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:28.311071 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.311022 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcgmv\" (UniqueName: \"kubernetes.io/projected/d76a07f2-0eb5-4177-a66f-9a094ce6facb-kube-api-access-lcgmv\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:47:28.311071 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.311041 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:47:28.311071 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.311050 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76a07f2-0eb5-4177-a66f-9a094ce6facb-util\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:47:28.998131 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.998069 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" Jul 06 23:47:28.998131 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.998078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nn4dm" event={"ID":"d76a07f2-0eb5-4177-a66f-9a094ce6facb","Type":"ContainerDied","Data":"b9ea14e9331f22272d97ea14738e027b6cf7448edf6cc233f5d947c407d89dc1"} Jul 06 23:47:28.998131 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:28.998126 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9ea14e9331f22272d97ea14738e027b6cf7448edf6cc233f5d947c407d89dc1" Jul 06 23:47:32.522381 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522349 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp"] Jul 06 23:47:32.522744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522609 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerName="util" Jul 06 23:47:32.522744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522619 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerName="util" Jul 06 23:47:32.522744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522626 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerName="pull" Jul 06 23:47:32.522744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522632 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerName="pull" Jul 06 23:47:32.522744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522637 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerName="extract" Jul 06 23:47:32.522744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522643 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerName="extract" Jul 06 23:47:32.522744 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.522697 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76a07f2-0eb5-4177-a66f-9a094ce6facb" containerName="extract" Jul 06 23:47:32.525301 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.525286 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.527717 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.527697 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 23:47:32.527717 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.527706 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4sgzl\"" Jul 06 23:47:32.527869 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.527730 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:47:32.537146 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.537124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp"] Jul 06 23:47:32.646158 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.646132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dgq7\" (UniqueName: \"kubernetes.io/projected/b76c5bb1-4914-4ec6-9399-9fc67c98d430-kube-api-access-2dgq7\") pod \"cert-manager-operator-controller-manager-55c444bf86-z7shp\" (UID: \"b76c5bb1-4914-4ec6-9399-9fc67c98d430\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.646284 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.646212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b76c5bb1-4914-4ec6-9399-9fc67c98d430-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z7shp\" (UID: \"b76c5bb1-4914-4ec6-9399-9fc67c98d430\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.746677 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.746650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b76c5bb1-4914-4ec6-9399-9fc67c98d430-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z7shp\" (UID: \"b76c5bb1-4914-4ec6-9399-9fc67c98d430\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.746771 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.746692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dgq7\" (UniqueName: \"kubernetes.io/projected/b76c5bb1-4914-4ec6-9399-9fc67c98d430-kube-api-access-2dgq7\") pod \"cert-manager-operator-controller-manager-55c444bf86-z7shp\" (UID: \"b76c5bb1-4914-4ec6-9399-9fc67c98d430\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.747065 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.747046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b76c5bb1-4914-4ec6-9399-9fc67c98d430-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z7shp\" (UID: \"b76c5bb1-4914-4ec6-9399-9fc67c98d430\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.754844 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.754816 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dgq7\" (UniqueName: \"kubernetes.io/projected/b76c5bb1-4914-4ec6-9399-9fc67c98d430-kube-api-access-2dgq7\") pod \"cert-manager-operator-controller-manager-55c444bf86-z7shp\" (UID: \"b76c5bb1-4914-4ec6-9399-9fc67c98d430\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.834402 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.834344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" Jul 06 23:47:32.969687 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:32.969650 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp"] Jul 06 23:47:32.972399 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:32.972375 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76c5bb1_4914_4ec6_9399_9fc67c98d430.slice/crio-d9d0c5a5abe1c6707e670c739b8fc81b6059f5c717dc159b6fd4af6002caa4c9 WatchSource:0}: Error finding container d9d0c5a5abe1c6707e670c739b8fc81b6059f5c717dc159b6fd4af6002caa4c9: Status 404 returned error can't find the container with id d9d0c5a5abe1c6707e670c739b8fc81b6059f5c717dc159b6fd4af6002caa4c9 Jul 06 23:47:33.014470 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:33.014439 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" event={"ID":"b76c5bb1-4914-4ec6-9399-9fc67c98d430","Type":"ContainerStarted","Data":"d9d0c5a5abe1c6707e670c739b8fc81b6059f5c717dc159b6fd4af6002caa4c9"} Jul 06 23:47:35.009461 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.009428 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lgfx7"] Jul 06 23:47:35.012324 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.012304 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.015213 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.015174 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 23:47:35.016431 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.016414 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 23:47:35.016505 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.016424 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dx667\"" Jul 06 23:47:35.023370 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.023338 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" event={"ID":"b76c5bb1-4914-4ec6-9399-9fc67c98d430","Type":"ContainerStarted","Data":"283c96c4904199e950cfabf21e376803e4014ee9576f25bf61fa798a4a115f02"} Jul 06 23:47:35.025845 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.025825 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lgfx7"] Jul 06 23:47:35.063915 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.063891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01528212-358c-45bd-b34d-47ba9520d67e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lgfx7\" (UID: \"01528212-358c-45bd-b34d-47ba9520d67e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.064014 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.063920 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9xll\" (UniqueName: \"kubernetes.io/projected/01528212-358c-45bd-b34d-47ba9520d67e-kube-api-access-g9xll\") pod \"cert-manager-webhook-6486ffd997-lgfx7\" (UID: \"01528212-358c-45bd-b34d-47ba9520d67e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.164939 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.164910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01528212-358c-45bd-b34d-47ba9520d67e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lgfx7\" (UID: \"01528212-358c-45bd-b34d-47ba9520d67e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.165013 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.164945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9xll\" (UniqueName: \"kubernetes.io/projected/01528212-358c-45bd-b34d-47ba9520d67e-kube-api-access-g9xll\") pod \"cert-manager-webhook-6486ffd997-lgfx7\" (UID: \"01528212-358c-45bd-b34d-47ba9520d67e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.173622 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.173592 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9xll\" (UniqueName: \"kubernetes.io/projected/01528212-358c-45bd-b34d-47ba9520d67e-kube-api-access-g9xll\") pod \"cert-manager-webhook-6486ffd997-lgfx7\" (UID: \"01528212-358c-45bd-b34d-47ba9520d67e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.173851 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.173830 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01528212-358c-45bd-b34d-47ba9520d67e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lgfx7\" (UID: \"01528212-358c-45bd-b34d-47ba9520d67e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.332305 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.332253 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:35.467595 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.467541 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z7shp" podStartSLOduration=2.211188121 podStartE2EDuration="3.467519153s" totalImagesPullingTime="1.256331032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:35.05952537 +0000 UTC m=+246.724700411" watchObservedRunningTime="2026-07-06 23:47:35.467519153 +0000 UTC m=+247.132694191" Jul 06 23:47:35.468131 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:35.468111 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lgfx7"] Jul 06 23:47:35.471022 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:35.470995 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01528212_358c_45bd_b34d_47ba9520d67e.slice/crio-ada5ec3019d2b2dd0f014ef7530b36c512bc1c28eaff13141f6388d046524202 WatchSource:0}: Error finding container ada5ec3019d2b2dd0f014ef7530b36c512bc1c28eaff13141f6388d046524202: Status 404 returned error can't find the container with id ada5ec3019d2b2dd0f014ef7530b36c512bc1c28eaff13141f6388d046524202 Jul 06 23:47:36.028641 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.028615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" event={"ID":"01528212-358c-45bd-b34d-47ba9520d67e","Type":"ContainerStarted","Data":"ada5ec3019d2b2dd0f014ef7530b36c512bc1c28eaff13141f6388d046524202"} Jul 06 23:47:36.784419 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.784383 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr"] Jul 06 23:47:36.787385 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.787328 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.790841 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.790814 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:47:36.791007 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.790818 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:47:36.791781 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.791756 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c8v96\"" Jul 06 23:47:36.798606 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.798548 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr"] Jul 06 23:47:36.875911 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.875875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv5gh\" (UniqueName: \"kubernetes.io/projected/4854786d-636d-4f1b-8afc-2d8923295652-kube-api-access-hv5gh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.876052 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.875924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.876052 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.876008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.977021 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.976996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv5gh\" (UniqueName: \"kubernetes.io/projected/4854786d-636d-4f1b-8afc-2d8923295652-kube-api-access-hv5gh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.977162 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.977036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.977162 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.977070 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.977476 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.977451 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.977476 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.977469 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:36.985737 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:36.985715 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv5gh\" (UniqueName: \"kubernetes.io/projected/4854786d-636d-4f1b-8afc-2d8923295652-kube-api-access-hv5gh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:37.099598 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.099540 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:37.249391 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.249242 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr"] Jul 06 23:47:37.252390 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:37.252359 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4854786d_636d_4f1b_8afc_2d8923295652.slice/crio-207952ac30a70c0c4fd43dc84f45d1307e063573c2ef97ca9090ff2294fdd34a WatchSource:0}: Error finding container 207952ac30a70c0c4fd43dc84f45d1307e063573c2ef97ca9090ff2294fdd34a: Status 404 returned error can't find the container with id 207952ac30a70c0c4fd43dc84f45d1307e063573c2ef97ca9090ff2294fdd34a Jul 06 23:47:37.498374 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.498345 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2b25j"] Jul 06 23:47:37.501755 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.501726 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:37.504212 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.504145 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-54tdx\"" Jul 06 23:47:37.510954 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.510927 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2b25j"] Jul 06 23:47:37.581993 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.581968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fmj\" (UniqueName: \"kubernetes.io/projected/9d4d9f99-65ea-43ae-9bb2-1062088186b5-kube-api-access-v9fmj\") pod \"cert-manager-cainjector-559cdd8c87-2b25j\" (UID: \"9d4d9f99-65ea-43ae-9bb2-1062088186b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:37.581993 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.582002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4d9f99-65ea-43ae-9bb2-1062088186b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2b25j\" (UID: \"9d4d9f99-65ea-43ae-9bb2-1062088186b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:37.683536 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.683500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fmj\" (UniqueName: \"kubernetes.io/projected/9d4d9f99-65ea-43ae-9bb2-1062088186b5-kube-api-access-v9fmj\") pod \"cert-manager-cainjector-559cdd8c87-2b25j\" (UID: \"9d4d9f99-65ea-43ae-9bb2-1062088186b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:37.683786 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.683548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4d9f99-65ea-43ae-9bb2-1062088186b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2b25j\" (UID: \"9d4d9f99-65ea-43ae-9bb2-1062088186b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:37.692430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.692391 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4d9f99-65ea-43ae-9bb2-1062088186b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2b25j\" (UID: \"9d4d9f99-65ea-43ae-9bb2-1062088186b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:37.692978 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.692952 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fmj\" (UniqueName: \"kubernetes.io/projected/9d4d9f99-65ea-43ae-9bb2-1062088186b5-kube-api-access-v9fmj\") pod \"cert-manager-cainjector-559cdd8c87-2b25j\" (UID: \"9d4d9f99-65ea-43ae-9bb2-1062088186b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:37.813642 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:37.813569 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" Jul 06 23:47:38.039235 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:38.039188 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" event={"ID":"4854786d-636d-4f1b-8afc-2d8923295652","Type":"ContainerStarted","Data":"207952ac30a70c0c4fd43dc84f45d1307e063573c2ef97ca9090ff2294fdd34a"} Jul 06 23:47:38.298600 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:38.298574 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2b25j"] Jul 06 23:47:38.309944 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:38.309916 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d4d9f99_65ea_43ae_9bb2_1062088186b5.slice/crio-94f0c35e1e454838691cda31d5a4f4b000b78f441a5077172a18d11a1511ebe6 WatchSource:0}: Error finding container 94f0c35e1e454838691cda31d5a4f4b000b78f441a5077172a18d11a1511ebe6: Status 404 returned error can't find the container with id 94f0c35e1e454838691cda31d5a4f4b000b78f441a5077172a18d11a1511ebe6 Jul 06 23:47:39.045257 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.045221 2556 generic.go:356] "Generic (PLEG): container finished" podID="4854786d-636d-4f1b-8afc-2d8923295652" containerID="ceb24763a70a44d1b433e321d7f61f26aca2a8d573748a3d108eb6d0312933ab" exitCode=0 Jul 06 23:47:39.045442 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.045287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" event={"ID":"4854786d-636d-4f1b-8afc-2d8923295652","Type":"ContainerDied","Data":"ceb24763a70a44d1b433e321d7f61f26aca2a8d573748a3d108eb6d0312933ab"} Jul 06 23:47:39.046940 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.046906 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" event={"ID":"01528212-358c-45bd-b34d-47ba9520d67e","Type":"ContainerStarted","Data":"3dce9d55983cbd3831b52a0bfb4dc87ed87c6636151ba7242e1e724663f2548b"} Jul 06 23:47:39.047031 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.046956 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:39.048393 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.048372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" event={"ID":"9d4d9f99-65ea-43ae-9bb2-1062088186b5","Type":"ContainerStarted","Data":"0a4ddbaea6688d7f372a273545a0c343e165e99c49ae23000b2020d456194919"} Jul 06 23:47:39.048483 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.048400 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" event={"ID":"9d4d9f99-65ea-43ae-9bb2-1062088186b5","Type":"ContainerStarted","Data":"94f0c35e1e454838691cda31d5a4f4b000b78f441a5077172a18d11a1511ebe6"} Jul 06 23:47:39.097704 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.097632 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" podStartSLOduration=2.368078675 podStartE2EDuration="5.097613338s" totalImagesPullingTime="2.729534663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:39.097456053 +0000 UTC m=+250.762631092" watchObservedRunningTime="2026-07-06 23:47:39.097613338 +0000 UTC m=+250.762788453" Jul 06 23:47:39.114865 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:39.114808 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2b25j" podStartSLOduration=2.114792878 podStartE2EDuration="2.114792878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:39.114080716 +0000 UTC m=+250.779255781" watchObservedRunningTime="2026-07-06 23:47:39.114792878 +0000 UTC m=+250.779967916" Jul 06 23:47:41.061061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:41.060989 2556 generic.go:356] "Generic (PLEG): container finished" podID="4854786d-636d-4f1b-8afc-2d8923295652" containerID="bf794a70d307c1847321f85b3c6e52dd90d458d7a48637808d08291db28e00ac" exitCode=0 Jul 06 23:47:41.061061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:41.061032 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" event={"ID":"4854786d-636d-4f1b-8afc-2d8923295652","Type":"ContainerDied","Data":"bf794a70d307c1847321f85b3c6e52dd90d458d7a48637808d08291db28e00ac"} Jul 06 23:47:42.067291 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:42.067258 2556 generic.go:356] "Generic (PLEG): container finished" podID="4854786d-636d-4f1b-8afc-2d8923295652" containerID="f90ef1a09cec9264925ec0c388b0a1a3a168ce95db76079a20f34bc719505f26" exitCode=0 Jul 06 23:47:42.067641 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:42.067300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" event={"ID":"4854786d-636d-4f1b-8afc-2d8923295652","Type":"ContainerDied","Data":"f90ef1a09cec9264925ec0c388b0a1a3a168ce95db76079a20f34bc719505f26"} Jul 06 23:47:43.197476 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.197450 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:43.328334 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.328275 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-bundle\") pod \"4854786d-636d-4f1b-8afc-2d8923295652\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " Jul 06 23:47:43.328334 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.328315 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-util\") pod \"4854786d-636d-4f1b-8afc-2d8923295652\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " Jul 06 23:47:43.328516 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.328361 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv5gh\" (UniqueName: \"kubernetes.io/projected/4854786d-636d-4f1b-8afc-2d8923295652-kube-api-access-hv5gh\") pod \"4854786d-636d-4f1b-8afc-2d8923295652\" (UID: \"4854786d-636d-4f1b-8afc-2d8923295652\") " Jul 06 23:47:43.328680 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.328657 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-bundle" (OuterVolumeSpecName: "bundle") pod "4854786d-636d-4f1b-8afc-2d8923295652" (UID: "4854786d-636d-4f1b-8afc-2d8923295652"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:43.330471 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.330450 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4854786d-636d-4f1b-8afc-2d8923295652-kube-api-access-hv5gh" (OuterVolumeSpecName: "kube-api-access-hv5gh") pod "4854786d-636d-4f1b-8afc-2d8923295652" (UID: "4854786d-636d-4f1b-8afc-2d8923295652"). InnerVolumeSpecName "kube-api-access-hv5gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:47:43.351327 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.351290 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-util" (OuterVolumeSpecName: "util") pod "4854786d-636d-4f1b-8afc-2d8923295652" (UID: "4854786d-636d-4f1b-8afc-2d8923295652"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:43.429383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.429365 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv5gh\" (UniqueName: \"kubernetes.io/projected/4854786d-636d-4f1b-8afc-2d8923295652-kube-api-access-hv5gh\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:47:43.429383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.429384 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:47:43.429512 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:43.429393 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4854786d-636d-4f1b-8afc-2d8923295652-util\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:47:44.077823 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:44.077793 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" Jul 06 23:47:44.077823 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:44.077815 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5pkhr" event={"ID":"4854786d-636d-4f1b-8afc-2d8923295652","Type":"ContainerDied","Data":"207952ac30a70c0c4fd43dc84f45d1307e063573c2ef97ca9090ff2294fdd34a"} Jul 06 23:47:44.078031 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:44.077856 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="207952ac30a70c0c4fd43dc84f45d1307e063573c2ef97ca9090ff2294fdd34a" Jul 06 23:47:45.057360 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.057321 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lgfx7" Jul 06 23:47:45.551495 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.551452 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l8brg"] Jul 06 23:47:45.551874 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.551852 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4854786d-636d-4f1b-8afc-2d8923295652" containerName="pull" Jul 06 23:47:45.551953 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.551878 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4854786d-636d-4f1b-8afc-2d8923295652" containerName="pull" Jul 06 23:47:45.551953 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.551892 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4854786d-636d-4f1b-8afc-2d8923295652" containerName="util" Jul 06 23:47:45.551953 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.551901 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4854786d-636d-4f1b-8afc-2d8923295652" containerName="util" Jul 06 23:47:45.551953 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.551941 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4854786d-636d-4f1b-8afc-2d8923295652" containerName="extract" Jul 06 23:47:45.551953 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.551951 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4854786d-636d-4f1b-8afc-2d8923295652" containerName="extract" Jul 06 23:47:45.552258 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.552042 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4854786d-636d-4f1b-8afc-2d8923295652" containerName="extract" Jul 06 23:47:45.555184 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.555145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:45.558924 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.558902 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jrxtj\"" Jul 06 23:47:45.572374 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.572349 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l8brg"] Jul 06 23:47:45.646545 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.646527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55d4486e-b8e7-400c-a61e-83ab01bb4a59-bound-sa-token\") pod \"cert-manager-55b4d954d5-l8brg\" (UID: \"55d4486e-b8e7-400c-a61e-83ab01bb4a59\") " pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:45.646628 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.646569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffpm\" (UniqueName: \"kubernetes.io/projected/55d4486e-b8e7-400c-a61e-83ab01bb4a59-kube-api-access-6ffpm\") pod \"cert-manager-55b4d954d5-l8brg\" (UID: \"55d4486e-b8e7-400c-a61e-83ab01bb4a59\") " pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:45.747110 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.747090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffpm\" (UniqueName: \"kubernetes.io/projected/55d4486e-b8e7-400c-a61e-83ab01bb4a59-kube-api-access-6ffpm\") pod \"cert-manager-55b4d954d5-l8brg\" (UID: \"55d4486e-b8e7-400c-a61e-83ab01bb4a59\") " pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:45.747218 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.747136 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55d4486e-b8e7-400c-a61e-83ab01bb4a59-bound-sa-token\") pod \"cert-manager-55b4d954d5-l8brg\" (UID: \"55d4486e-b8e7-400c-a61e-83ab01bb4a59\") " pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:45.755765 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.755730 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55d4486e-b8e7-400c-a61e-83ab01bb4a59-bound-sa-token\") pod \"cert-manager-55b4d954d5-l8brg\" (UID: \"55d4486e-b8e7-400c-a61e-83ab01bb4a59\") " pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:45.756104 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.756079 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffpm\" (UniqueName: \"kubernetes.io/projected/55d4486e-b8e7-400c-a61e-83ab01bb4a59-kube-api-access-6ffpm\") pod \"cert-manager-55b4d954d5-l8brg\" (UID: \"55d4486e-b8e7-400c-a61e-83ab01bb4a59\") " pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:45.865546 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:45.865499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-l8brg" Jul 06 23:47:46.009311 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:46.009257 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l8brg"] Jul 06 23:47:46.011221 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:46.011180 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55d4486e_b8e7_400c_a61e_83ab01bb4a59.slice/crio-ceee8e521db43a3f2ce855710cd3b5007f5de99296a26c9aa279304ae0bbdcdf WatchSource:0}: Error finding container ceee8e521db43a3f2ce855710cd3b5007f5de99296a26c9aa279304ae0bbdcdf: Status 404 returned error can't find the container with id ceee8e521db43a3f2ce855710cd3b5007f5de99296a26c9aa279304ae0bbdcdf Jul 06 23:47:46.091825 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:46.091797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-l8brg" event={"ID":"55d4486e-b8e7-400c-a61e-83ab01bb4a59","Type":"ContainerStarted","Data":"f1ae10a6ccdaf863e895468c10fb00c4ac0f13eb31f3e44401a17cf097561c82"} Jul 06 23:47:46.092235 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:46.091837 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-l8brg" event={"ID":"55d4486e-b8e7-400c-a61e-83ab01bb4a59","Type":"ContainerStarted","Data":"ceee8e521db43a3f2ce855710cd3b5007f5de99296a26c9aa279304ae0bbdcdf"} Jul 06 23:47:46.110386 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:46.110342 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-l8brg" podStartSLOduration=1.110328249 podStartE2EDuration="1.110328249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:46.108794217 +0000 UTC m=+257.773969262" watchObservedRunningTime="2026-07-06 23:47:46.110328249 +0000 UTC m=+257.775503286" Jul 06 23:47:50.496750 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.496676 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c"] Jul 06 23:47:50.499671 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.499653 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.502429 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.502410 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 23:47:50.502514 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.502426 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:47:50.503159 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.503143 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5twwd\"" Jul 06 23:47:50.508186 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.508153 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c"] Jul 06 23:47:50.584365 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.584340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4b2p\" (UniqueName: \"kubernetes.io/projected/2b4afa52-4b1c-451b-9126-d010ea51fdc3-kube-api-access-w4b2p\") pod \"openshift-lws-operator-fd8ccff4c-sxc2c\" (UID: \"2b4afa52-4b1c-451b-9126-d010ea51fdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.584477 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.584388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4afa52-4b1c-451b-9126-d010ea51fdc3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxc2c\" (UID: \"2b4afa52-4b1c-451b-9126-d010ea51fdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.685349 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.685323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4b2p\" (UniqueName: \"kubernetes.io/projected/2b4afa52-4b1c-451b-9126-d010ea51fdc3-kube-api-access-w4b2p\") pod \"openshift-lws-operator-fd8ccff4c-sxc2c\" (UID: \"2b4afa52-4b1c-451b-9126-d010ea51fdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.685435 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.685369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4afa52-4b1c-451b-9126-d010ea51fdc3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxc2c\" (UID: \"2b4afa52-4b1c-451b-9126-d010ea51fdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.685731 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.685715 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4afa52-4b1c-451b-9126-d010ea51fdc3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxc2c\" (UID: \"2b4afa52-4b1c-451b-9126-d010ea51fdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.693766 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.693740 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4b2p\" (UniqueName: \"kubernetes.io/projected/2b4afa52-4b1c-451b-9126-d010ea51fdc3-kube-api-access-w4b2p\") pod \"openshift-lws-operator-fd8ccff4c-sxc2c\" (UID: \"2b4afa52-4b1c-451b-9126-d010ea51fdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.810076 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.810023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" Jul 06 23:47:50.938916 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:50.938895 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c"] Jul 06 23:47:50.941040 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:50.941013 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b4afa52_4b1c_451b_9126_d010ea51fdc3.slice/crio-fae2a8bace5c8088c35f4e15da8675e3bc20aaf957c89a3bc00330db3f7704d5 WatchSource:0}: Error finding container fae2a8bace5c8088c35f4e15da8675e3bc20aaf957c89a3bc00330db3f7704d5: Status 404 returned error can't find the container with id fae2a8bace5c8088c35f4e15da8675e3bc20aaf957c89a3bc00330db3f7704d5 Jul 06 23:47:51.114161 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:51.114098 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" event={"ID":"2b4afa52-4b1c-451b-9126-d010ea51fdc3","Type":"ContainerStarted","Data":"fae2a8bace5c8088c35f4e15da8675e3bc20aaf957c89a3bc00330db3f7704d5"} Jul 06 23:47:53.126083 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:53.126048 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" event={"ID":"2b4afa52-4b1c-451b-9126-d010ea51fdc3","Type":"ContainerStarted","Data":"5b14c2acc0549afd7d20e8677fb34eb767dd72c13d4e1d0c1cc89e0a718b2b27"} Jul 06 23:47:53.145565 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:53.145477 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxc2c" podStartSLOduration=1.205140453 podStartE2EDuration="3.145461845s" totalImagesPullingTime="1.940321392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:53.144539548 +0000 UTC m=+264.809714586" watchObservedRunningTime="2026-07-06 23:47:53.145461845 +0000 UTC m=+264.810636883" Jul 06 23:47:56.075316 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.075275 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm"] Jul 06 23:47:56.092198 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.092178 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.097435 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.097401 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c8v96\"" Jul 06 23:47:56.097590 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.097569 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:47:56.098156 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.098135 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:47:56.098740 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.098715 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm"] Jul 06 23:47:56.223257 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.223232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.223365 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.223275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4r9\" (UniqueName: \"kubernetes.io/projected/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-kube-api-access-5k4r9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.223365 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.223307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.324540 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.324516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.324636 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.324562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4r9\" (UniqueName: \"kubernetes.io/projected/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-kube-api-access-5k4r9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.324636 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.324599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.324942 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.324923 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.324981 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.324954 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.334072 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.334014 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4r9\" (UniqueName: \"kubernetes.io/projected/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-kube-api-access-5k4r9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.401834 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.401813 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:47:56.547215 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:56.547177 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm"] Jul 06 23:47:56.549161 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:47:56.549130 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f6f19c_64d3_4c84_815e_24d2b2ec2cd6.slice/crio-ec106fe6e45b527698694f7e20a56d4e7f4199ea869d4064e4d2528d731d74c4 WatchSource:0}: Error finding container ec106fe6e45b527698694f7e20a56d4e7f4199ea869d4064e4d2528d731d74c4: Status 404 returned error can't find the container with id ec106fe6e45b527698694f7e20a56d4e7f4199ea869d4064e4d2528d731d74c4 Jul 06 23:47:57.144356 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:57.144331 2556 generic.go:356] "Generic (PLEG): container finished" podID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerID="d5a3389090c0f84966020ed6a7d6e68b49ab03256dae62a04bee6b7a07511042" exitCode=0 Jul 06 23:47:57.144690 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:57.144408 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" event={"ID":"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6","Type":"ContainerDied","Data":"d5a3389090c0f84966020ed6a7d6e68b49ab03256dae62a04bee6b7a07511042"} Jul 06 23:47:57.144690 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:57.144449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" event={"ID":"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6","Type":"ContainerStarted","Data":"ec106fe6e45b527698694f7e20a56d4e7f4199ea869d4064e4d2528d731d74c4"} Jul 06 23:47:58.151272 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:58.151241 2556 generic.go:356] "Generic (PLEG): container finished" podID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerID="94704cecdfb063ecfcad794e05253fada14390a463c7fc3e3903d7ee05a5cd97" exitCode=0 Jul 06 23:47:58.151625 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:58.151306 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" event={"ID":"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6","Type":"ContainerDied","Data":"94704cecdfb063ecfcad794e05253fada14390a463c7fc3e3903d7ee05a5cd97"} Jul 06 23:47:59.157475 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:59.157446 2556 generic.go:356] "Generic (PLEG): container finished" podID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerID="a8c0db9334bdd883603e47c6e5cbf2243f9bb165423dd0524d5a408faeb2078e" exitCode=0 Jul 06 23:47:59.157861 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:47:59.157525 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" event={"ID":"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6","Type":"ContainerDied","Data":"a8c0db9334bdd883603e47c6e5cbf2243f9bb165423dd0524d5a408faeb2078e"} Jul 06 23:48:00.294390 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.294370 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:48:00.454583 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.454516 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k4r9\" (UniqueName: \"kubernetes.io/projected/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-kube-api-access-5k4r9\") pod \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " Jul 06 23:48:00.454712 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.454579 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-bundle\") pod \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " Jul 06 23:48:00.454712 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.454627 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-util\") pod \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\" (UID: \"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6\") " Jul 06 23:48:00.455337 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.455305 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-bundle" (OuterVolumeSpecName: "bundle") pod "b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" (UID: "b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:48:00.456731 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.456697 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-kube-api-access-5k4r9" (OuterVolumeSpecName: "kube-api-access-5k4r9") pod "b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" (UID: "b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6"). InnerVolumeSpecName "kube-api-access-5k4r9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:48:00.459890 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.459866 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-util" (OuterVolumeSpecName: "util") pod "b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" (UID: "b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:48:00.555395 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.555360 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-util\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:00.555395 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.555390 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k4r9\" (UniqueName: \"kubernetes.io/projected/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-kube-api-access-5k4r9\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:00.555395 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:00.555401 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:01.168581 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:01.168551 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" event={"ID":"b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6","Type":"ContainerDied","Data":"ec106fe6e45b527698694f7e20a56d4e7f4199ea869d4064e4d2528d731d74c4"} Jul 06 23:48:01.168581 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:01.168573 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhdhcm" Jul 06 23:48:01.168796 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:01.168601 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec106fe6e45b527698694f7e20a56d4e7f4199ea869d4064e4d2528d731d74c4" Jul 06 23:48:13.845249 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845217 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9"] Jul 06 23:48:13.845648 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845495 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerName="pull" Jul 06 23:48:13.845648 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845505 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerName="pull" Jul 06 23:48:13.845648 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845524 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerName="extract" Jul 06 23:48:13.845648 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845530 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerName="extract" Jul 06 23:48:13.845648 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845541 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerName="util" Jul 06 23:48:13.845648 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845548 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerName="util" Jul 06 23:48:13.845648 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.845594 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f6f19c-64d3-4c84-815e-24d2b2ec2cd6" containerName="extract" Jul 06 23:48:13.848257 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.848242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:13.851811 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.851790 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 23:48:13.851919 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.851895 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 23:48:13.852223 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.852182 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 23:48:13.852545 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.852526 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v8hd2\"" Jul 06 23:48:13.852630 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.852613 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 23:48:13.870756 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.870738 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9"] Jul 06 23:48:13.954608 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.954580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/017951a0-001c-4efb-8d9a-93f8a00109ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:13.954714 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.954616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkshc\" (UniqueName: \"kubernetes.io/projected/017951a0-001c-4efb-8d9a-93f8a00109ac-kube-api-access-mkshc\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:13.954714 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.954649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/017951a0-001c-4efb-8d9a-93f8a00109ac-manifests\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:13.954714 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.954706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/017951a0-001c-4efb-8d9a-93f8a00109ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:13.954836 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:13.954787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/017951a0-001c-4efb-8d9a-93f8a00109ac-tmp\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.055221 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.055178 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/017951a0-001c-4efb-8d9a-93f8a00109ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.055307 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.055224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkshc\" (UniqueName: \"kubernetes.io/projected/017951a0-001c-4efb-8d9a-93f8a00109ac-kube-api-access-mkshc\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.055307 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.055242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/017951a0-001c-4efb-8d9a-93f8a00109ac-manifests\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.055307 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.055273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/017951a0-001c-4efb-8d9a-93f8a00109ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.055427 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.055324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/017951a0-001c-4efb-8d9a-93f8a00109ac-tmp\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.055650 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.055629 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/017951a0-001c-4efb-8d9a-93f8a00109ac-manifests\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.057578 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.057552 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/017951a0-001c-4efb-8d9a-93f8a00109ac-tmp\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.057686 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.057594 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/017951a0-001c-4efb-8d9a-93f8a00109ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.057771 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.057750 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/017951a0-001c-4efb-8d9a-93f8a00109ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.063738 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.063714 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkshc\" (UniqueName: \"kubernetes.io/projected/017951a0-001c-4efb-8d9a-93f8a00109ac-kube-api-access-mkshc\") pod \"opendatahub-operator-controller-manager-6688846b76-lzgv9\" (UID: \"017951a0-001c-4efb-8d9a-93f8a00109ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.158288 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.158268 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:14.336961 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:14.336791 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9"] Jul 06 23:48:14.339877 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:48:14.339847 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017951a0_001c_4efb_8d9a_93f8a00109ac.slice/crio-11952644c78eb19dd86b351179a83c67a222bb02602f0638c473527a097a8c5b WatchSource:0}: Error finding container 11952644c78eb19dd86b351179a83c67a222bb02602f0638c473527a097a8c5b: Status 404 returned error can't find the container with id 11952644c78eb19dd86b351179a83c67a222bb02602f0638c473527a097a8c5b Jul 06 23:48:15.237582 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:15.237546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" event={"ID":"017951a0-001c-4efb-8d9a-93f8a00109ac","Type":"ContainerStarted","Data":"11952644c78eb19dd86b351179a83c67a222bb02602f0638c473527a097a8c5b"} Jul 06 23:48:17.247851 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:17.247821 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" event={"ID":"017951a0-001c-4efb-8d9a-93f8a00109ac","Type":"ContainerStarted","Data":"c2dc8b23e4fba62b87f47b23074e9dcf2d866e835a1c634d825dea8c1d8b01f9"} Jul 06 23:48:19.258251 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:19.258216 2556 generic.go:356] "Generic (PLEG): container finished" podID="017951a0-001c-4efb-8d9a-93f8a00109ac" containerID="c2dc8b23e4fba62b87f47b23074e9dcf2d866e835a1c634d825dea8c1d8b01f9" exitCode=0 Jul 06 23:48:19.258613 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:19.258272 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" event={"ID":"017951a0-001c-4efb-8d9a-93f8a00109ac","Type":"ContainerDied","Data":"c2dc8b23e4fba62b87f47b23074e9dcf2d866e835a1c634d825dea8c1d8b01f9"} Jul 06 23:48:20.266082 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:20.266037 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" event={"ID":"017951a0-001c-4efb-8d9a-93f8a00109ac","Type":"ContainerStarted","Data":"ac710ec57092cfcb11a1fa72b2823844f527ca71352c4c0065656b7bbf4ff3a1"} Jul 06 23:48:20.266498 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:20.266379 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:20.294364 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:20.294307 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" podStartSLOduration=3.080119086 podStartE2EDuration="7.294291023s" totalImagesPullingTime="3.176610315s" totalInitContainerRuntime="1.037561622s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:20.291311397 +0000 UTC m=+291.956486455" watchObservedRunningTime="2026-07-06 23:48:20.294291023 +0000 UTC m=+291.959466062" Jul 06 23:48:28.763459 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:28.763434 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 23:48:31.272255 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:31.272187 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-lzgv9" Jul 06 23:48:35.031136 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.031107 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4"] Jul 06 23:48:35.034427 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.034407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.036728 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.036700 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 23:48:35.036983 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.036967 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ndbds\"" Jul 06 23:48:35.037794 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.037779 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 23:48:35.037864 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.037816 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 23:48:35.037864 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.037834 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 23:48:35.047631 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.047602 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4"] Jul 06 23:48:35.109092 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.109070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-tmp\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.109220 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.109127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-tls-certs\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.109220 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.109148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z22hm\" (UniqueName: \"kubernetes.io/projected/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-kube-api-access-z22hm\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.210042 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.210004 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-tmp\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.210186 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.210116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-tls-certs\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.210186 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.210145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22hm\" (UniqueName: \"kubernetes.io/projected/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-kube-api-access-z22hm\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.212644 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.212616 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-tmp\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.213321 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.213299 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-tls-certs\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.226948 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.226902 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z22hm\" (UniqueName: \"kubernetes.io/projected/fd39d95d-41f4-44b4-ba1d-0b964b28d1cd-kube-api-access-z22hm\") pod \"kube-auth-proxy-8675bbfddd-rpnc4\" (UID: \"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.343902 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.343818 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" Jul 06 23:48:35.479791 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.479768 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4"] Jul 06 23:48:35.481579 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:48:35.481553 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd39d95d_41f4_44b4_ba1d_0b964b28d1cd.slice/crio-9af4e128fd0dbb47692003c3ad03c01d62e992b017c1e9dfa9765ea05694ec56 WatchSource:0}: Error finding container 9af4e128fd0dbb47692003c3ad03c01d62e992b017c1e9dfa9765ea05694ec56: Status 404 returned error can't find the container with id 9af4e128fd0dbb47692003c3ad03c01d62e992b017c1e9dfa9765ea05694ec56 Jul 06 23:48:35.483683 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:35.483653 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:48:36.338968 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.338933 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" event={"ID":"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd","Type":"ContainerStarted","Data":"9af4e128fd0dbb47692003c3ad03c01d62e992b017c1e9dfa9765ea05694ec56"} Jul 06 23:48:36.473779 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.473750 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn"] Jul 06 23:48:36.477053 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.477033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.480165 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.480134 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 23:48:36.480274 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.480167 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kxpkc\"" Jul 06 23:48:36.480274 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.480221 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 23:48:36.480274 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.480227 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 23:48:36.480274 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.480264 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 23:48:36.490430 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.490410 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn"] Jul 06 23:48:36.520721 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.520697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-token\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.520842 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.520736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.520842 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.520808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-cacerts\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.520944 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.520857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.520944 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.520887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.520944 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.520906 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srnnm\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-kube-api-access-srnnm\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.521044 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.520981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/859a02f4-54e7-41f7-be9d-4547cf6a8a11-local-certs\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622079 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622079 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-cacerts\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622079 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622339 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622339 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srnnm\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-kube-api-access-srnnm\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622339 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/859a02f4-54e7-41f7-be9d-4547cf6a8a11-local-certs\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622339 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-token\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.622729 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.622710 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.624532 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.624502 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.624950 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.624929 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/859a02f4-54e7-41f7-be9d-4547cf6a8a11-local-certs\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.625137 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.625124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-cacerts\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.625276 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.625256 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.631840 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.631817 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srnnm\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-kube-api-access-srnnm\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.631972 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.631955 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-token\") pod \"istiod-openshift-gateway-7574459656-pxmtn\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.788535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.788499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:36.930451 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:36.930409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn"] Jul 06 23:48:36.934977 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:48:36.934940 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859a02f4_54e7_41f7_be9d_4547cf6a8a11.slice/crio-0128f93f088a360c4e51390a96ee592b642a200941b044dda7cbd6884024c8dc WatchSource:0}: Error finding container 0128f93f088a360c4e51390a96ee592b642a200941b044dda7cbd6884024c8dc: Status 404 returned error can't find the container with id 0128f93f088a360c4e51390a96ee592b642a200941b044dda7cbd6884024c8dc Jul 06 23:48:37.345707 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:37.345663 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" event={"ID":"859a02f4-54e7-41f7-be9d-4547cf6a8a11","Type":"ContainerStarted","Data":"0128f93f088a360c4e51390a96ee592b642a200941b044dda7cbd6884024c8dc"} Jul 06 23:48:38.353024 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:38.352980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" event={"ID":"fd39d95d-41f4-44b4-ba1d-0b964b28d1cd","Type":"ContainerStarted","Data":"ff0185137af92cd32a6df4df12008bbfd3fb3c42f064d46c6f22bcae0d418c4e"} Jul 06 23:48:38.370721 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:38.370674 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-rpnc4" podStartSLOduration=1.072474205 podStartE2EDuration="3.37065978s" totalImagesPullingTime="2.298185575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:38.369264459 +0000 UTC m=+310.034439497" watchObservedRunningTime="2026-07-06 23:48:38.37065978 +0000 UTC m=+310.035834817" Jul 06 23:48:39.573347 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:39.573315 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 23:48:39.573593 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:39.573375 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 23:48:40.365432 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:40.365397 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" event={"ID":"859a02f4-54e7-41f7-be9d-4547cf6a8a11","Type":"ContainerStarted","Data":"ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889"} Jul 06 23:48:40.365620 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:40.365602 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:40.367003 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:40.366980 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pxmtn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 23:48:40.367106 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:40.367022 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" podUID="859a02f4-54e7-41f7-be9d-4547cf6a8a11" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 23:48:40.386362 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:40.386315 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" podStartSLOduration=1.75219324 podStartE2EDuration="4.386303061s" totalImagesPullingTime="2.634109821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:40.38508267 +0000 UTC m=+312.050257709" watchObservedRunningTime="2026-07-06 23:48:40.386303061 +0000 UTC m=+312.051478100" Jul 06 23:48:41.370383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:41.370358 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:43.009173 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.009140 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc"] Jul 06 23:48:43.012528 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.012507 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.025586 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.025564 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc"] Jul 06 23:48:43.077410 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.077383 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.077507 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.077419 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.077507 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.077485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.077576 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.077509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.077576 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.077529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.077639 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.077598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.077639 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.077616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbgsw\" (UniqueName: \"kubernetes.io/projected/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-kube-api-access-wbgsw\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.178248 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.178220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.178352 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.178269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.178352 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.178307 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.178352 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.178324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.178513 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.178367 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.178513 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.178412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.178513 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.178439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbgsw\" (UniqueName: \"kubernetes.io/projected/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-kube-api-access-wbgsw\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.179369 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.179341 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.180845 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.180817 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.180951 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.180843 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.181065 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.181046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.181122 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.181048 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.186893 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.186871 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.187293 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.187271 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbgsw\" (UniqueName: \"kubernetes.io/projected/e752d5c8-8f92-4e18-b2c3-86b67b0644c0-kube-api-access-wbgsw\") pod \"istiod-openshift-gateway-94bb8fbfd-xz2kc\" (UID: \"e752d5c8-8f92-4e18-b2c3-86b67b0644c0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.321208 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.321139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:43.470137 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.470112 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc"] Jul 06 23:48:43.472295 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:48:43.472267 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode752d5c8_8f92_4e18_b2c3_86b67b0644c0.slice/crio-d29a305934a10679922372e6ccf59abd254fbd7f28c5eda8cf79a98de51e6dea WatchSource:0}: Error finding container d29a305934a10679922372e6ccf59abd254fbd7f28c5eda8cf79a98de51e6dea: Status 404 returned error can't find the container with id d29a305934a10679922372e6ccf59abd254fbd7f28c5eda8cf79a98de51e6dea Jul 06 23:48:43.475345 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.475315 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 23:48:43.475460 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:43.475371 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 23:48:44.395305 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.395273 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" event={"ID":"e752d5c8-8f92-4e18-b2c3-86b67b0644c0","Type":"ContainerStarted","Data":"e74a2c51b46f814796070bd31d93e19e079e67b741ddcc4c59bf2496988630a4"} Jul 06 23:48:44.395798 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.395769 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" event={"ID":"e752d5c8-8f92-4e18-b2c3-86b67b0644c0","Type":"ContainerStarted","Data":"d29a305934a10679922372e6ccf59abd254fbd7f28c5eda8cf79a98de51e6dea"} Jul 06 23:48:44.395798 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.395804 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:44.397535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.397513 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" Jul 06 23:48:44.444384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.444331 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xz2kc" podStartSLOduration=2.44431377 podStartE2EDuration="2.44431377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:44.419343662 +0000 UTC m=+316.084518700" watchObservedRunningTime="2026-07-06 23:48:44.44431377 +0000 UTC m=+316.109488808" Jul 06 23:48:44.485402 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.485361 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn"] Jul 06 23:48:44.485844 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.485815 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" podUID="859a02f4-54e7-41f7-be9d-4547cf6a8a11" containerName="discovery" containerID="cri-o://ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889" gracePeriod=30 Jul 06 23:48:44.731351 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.731331 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:44.794461 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794437 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srnnm\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-kube-api-access-srnnm\") pod \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " Jul 06 23:48:44.794593 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794472 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/859a02f4-54e7-41f7-be9d-4547cf6a8a11-local-certs\") pod \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " Jul 06 23:48:44.794593 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794523 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-dns-cert\") pod \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " Jul 06 23:48:44.794593 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794576 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-ca-configmap\") pod \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " Jul 06 23:48:44.794765 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794703 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-cacerts\") pod \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " Jul 06 23:48:44.794765 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794741 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-token\") pod \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " Jul 06 23:48:44.794869 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794785 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-kubeconfig\") pod \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\" (UID: \"859a02f4-54e7-41f7-be9d-4547cf6a8a11\") " Jul 06 23:48:44.797351 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.794950 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "859a02f4-54e7-41f7-be9d-4547cf6a8a11" (UID: "859a02f4-54e7-41f7-be9d-4547cf6a8a11"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:48:44.802868 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.797984 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/859a02f4-54e7-41f7-be9d-4547cf6a8a11-local-certs" (OuterVolumeSpecName: "local-certs") pod "859a02f4-54e7-41f7-be9d-4547cf6a8a11" (UID: "859a02f4-54e7-41f7-be9d-4547cf6a8a11"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:48:44.802939 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.802911 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "859a02f4-54e7-41f7-be9d-4547cf6a8a11" (UID: "859a02f4-54e7-41f7-be9d-4547cf6a8a11"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:48:44.802939 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.802927 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-cacerts" (OuterVolumeSpecName: "cacerts") pod "859a02f4-54e7-41f7-be9d-4547cf6a8a11" (UID: "859a02f4-54e7-41f7-be9d-4547cf6a8a11"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:48:44.803041 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.802941 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "859a02f4-54e7-41f7-be9d-4547cf6a8a11" (UID: "859a02f4-54e7-41f7-be9d-4547cf6a8a11"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:48:44.803041 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.802952 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-kube-api-access-srnnm" (OuterVolumeSpecName: "kube-api-access-srnnm") pod "859a02f4-54e7-41f7-be9d-4547cf6a8a11" (UID: "859a02f4-54e7-41f7-be9d-4547cf6a8a11"). InnerVolumeSpecName "kube-api-access-srnnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:48:44.803041 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.803020 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-token" (OuterVolumeSpecName: "istio-token") pod "859a02f4-54e7-41f7-be9d-4547cf6a8a11" (UID: "859a02f4-54e7-41f7-be9d-4547cf6a8a11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:48:44.896471 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.896448 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-dns-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:44.896471 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.896468 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-csr-ca-configmap\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:44.896600 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.896477 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-cacerts\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:44.896600 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.896487 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-token\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:44.896600 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.896495 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/859a02f4-54e7-41f7-be9d-4547cf6a8a11-istio-kubeconfig\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:44.896600 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.896502 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srnnm\" (UniqueName: \"kubernetes.io/projected/859a02f4-54e7-41f7-be9d-4547cf6a8a11-kube-api-access-srnnm\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:44.896600 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:44.896511 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/859a02f4-54e7-41f7-be9d-4547cf6a8a11-local-certs\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:48:45.400915 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.400877 2556 generic.go:356] "Generic (PLEG): container finished" podID="859a02f4-54e7-41f7-be9d-4547cf6a8a11" containerID="ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889" exitCode=0 Jul 06 23:48:45.401388 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.400938 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" Jul 06 23:48:45.401388 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.400970 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" event={"ID":"859a02f4-54e7-41f7-be9d-4547cf6a8a11","Type":"ContainerDied","Data":"ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889"} Jul 06 23:48:45.401388 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.401016 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn" event={"ID":"859a02f4-54e7-41f7-be9d-4547cf6a8a11","Type":"ContainerDied","Data":"0128f93f088a360c4e51390a96ee592b642a200941b044dda7cbd6884024c8dc"} Jul 06 23:48:45.401388 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.401040 2556 scope.go:117] "RemoveContainer" containerID="ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889" Jul 06 23:48:45.409629 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.409603 2556 scope.go:117] "RemoveContainer" containerID="ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889" Jul 06 23:48:45.409880 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:48:45.409859 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889\": container with ID starting with ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889 not found: ID does not exist" containerID="ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889" Jul 06 23:48:45.409983 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.409887 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889"} err="failed to get container status \"ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889\": rpc error: code = NotFound desc = could not find container \"ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889\": container with ID starting with ed7af844657c3ee00adde3bc1ee93ff1582814bac1c6e61058b54b7338169889 not found: ID does not exist" Jul 06 23:48:45.443935 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.443908 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn"] Jul 06 23:48:45.456261 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.456236 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pxmtn"] Jul 06 23:48:45.567853 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.567827 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz"] Jul 06 23:48:45.568151 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.568139 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="859a02f4-54e7-41f7-be9d-4547cf6a8a11" containerName="discovery" Jul 06 23:48:45.568209 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.568153 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="859a02f4-54e7-41f7-be9d-4547cf6a8a11" containerName="discovery" Jul 06 23:48:45.568242 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.568225 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="859a02f4-54e7-41f7-be9d-4547cf6a8a11" containerName="discovery" Jul 06 23:48:45.572181 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.572163 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8"] Jul 06 23:48:45.572292 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.572277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:45.574686 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.574670 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-824jq\"" Jul 06 23:48:45.574941 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.574924 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 23:48:45.575346 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.575332 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:45.577381 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.577367 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-krlkh\"" Jul 06 23:48:45.577590 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.577576 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 06 23:48:45.589340 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.589322 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz"] Jul 06 23:48:45.591082 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.591066 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8"] Jul 06 23:48:45.602338 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.602318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6x9\" (UniqueName: \"kubernetes.io/projected/25917143-35e0-4cb5-bee3-5ae8f9064557-kube-api-access-zl6x9\") pod \"llmisvc-controller-manager-777c6bd7d5-686x8\" (UID: \"25917143-35e0-4cb5-bee3-5ae8f9064557\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:45.602436 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.602360 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-cert\") pod \"kserve-controller-manager-d6f4b65b8-5bsjz\" (UID: \"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:45.602436 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.602386 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5kk6\" (UniqueName: \"kubernetes.io/projected/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-kube-api-access-b5kk6\") pod \"kserve-controller-manager-d6f4b65b8-5bsjz\" (UID: \"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:45.602548 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.602508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25917143-35e0-4cb5-bee3-5ae8f9064557-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-686x8\" (UID: \"25917143-35e0-4cb5-bee3-5ae8f9064557\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:45.702844 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.702794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-cert\") pod \"kserve-controller-manager-d6f4b65b8-5bsjz\" (UID: \"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:45.702844 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.702828 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5kk6\" (UniqueName: \"kubernetes.io/projected/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-kube-api-access-b5kk6\") pod \"kserve-controller-manager-d6f4b65b8-5bsjz\" (UID: \"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:45.702988 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.702868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25917143-35e0-4cb5-bee3-5ae8f9064557-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-686x8\" (UID: \"25917143-35e0-4cb5-bee3-5ae8f9064557\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:45.702988 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.702891 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6x9\" (UniqueName: \"kubernetes.io/projected/25917143-35e0-4cb5-bee3-5ae8f9064557-kube-api-access-zl6x9\") pod \"llmisvc-controller-manager-777c6bd7d5-686x8\" (UID: \"25917143-35e0-4cb5-bee3-5ae8f9064557\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:45.702988 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:48:45.702937 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 06 23:48:45.702988 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:48:45.702976 2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 06 23:48:45.703129 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:48:45.703005 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-cert podName:1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:46.20299113 +0000 UTC m=+317.868166150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-cert") pod "kserve-controller-manager-d6f4b65b8-5bsjz" (UID: "1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937") : secret "kserve-webhook-server-cert" not found Jul 06 23:48:45.703129 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:48:45.703030 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25917143-35e0-4cb5-bee3-5ae8f9064557-cert podName:25917143-35e0-4cb5-bee3-5ae8f9064557 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:46.20301193 +0000 UTC m=+317.868186964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25917143-35e0-4cb5-bee3-5ae8f9064557-cert") pod "llmisvc-controller-manager-777c6bd7d5-686x8" (UID: "25917143-35e0-4cb5-bee3-5ae8f9064557") : secret "llmisvc-webhook-server-cert" not found Jul 06 23:48:45.713517 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.713489 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5kk6\" (UniqueName: \"kubernetes.io/projected/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-kube-api-access-b5kk6\") pod \"kserve-controller-manager-d6f4b65b8-5bsjz\" (UID: \"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:45.713801 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:45.713786 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6x9\" (UniqueName: \"kubernetes.io/projected/25917143-35e0-4cb5-bee3-5ae8f9064557-kube-api-access-zl6x9\") pod \"llmisvc-controller-manager-777c6bd7d5-686x8\" (UID: \"25917143-35e0-4cb5-bee3-5ae8f9064557\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:46.206683 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.206648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25917143-35e0-4cb5-bee3-5ae8f9064557-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-686x8\" (UID: \"25917143-35e0-4cb5-bee3-5ae8f9064557\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:46.206848 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.206706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-cert\") pod \"kserve-controller-manager-d6f4b65b8-5bsjz\" (UID: \"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:46.209250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.209219 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937-cert\") pod \"kserve-controller-manager-d6f4b65b8-5bsjz\" (UID: \"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:46.209250 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.209234 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25917143-35e0-4cb5-bee3-5ae8f9064557-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-686x8\" (UID: \"25917143-35e0-4cb5-bee3-5ae8f9064557\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:46.484244 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.484153 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:46.491165 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.491148 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:48:46.624482 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.624118 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz"] Jul 06 23:48:46.626766 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:48:46.626740 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4d3bcb_76e8_4c58_a7c0_ca9d5b727937.slice/crio-f2a48cfa161220b458f290fa1ff02f432d03b083eebe5cb368bd52e879e1026e WatchSource:0}: Error finding container f2a48cfa161220b458f290fa1ff02f432d03b083eebe5cb368bd52e879e1026e: Status 404 returned error can't find the container with id f2a48cfa161220b458f290fa1ff02f432d03b083eebe5cb368bd52e879e1026e Jul 06 23:48:46.645847 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.645828 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8"] Jul 06 23:48:46.648108 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:48:46.648072 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod25917143_35e0_4cb5_bee3_5ae8f9064557.slice/crio-dd77af2ce117e0328c405decd1265ea3c1fef22e53f90a475caa04ccaae92cb9 WatchSource:0}: Error finding container dd77af2ce117e0328c405decd1265ea3c1fef22e53f90a475caa04ccaae92cb9: Status 404 returned error can't find the container with id dd77af2ce117e0328c405decd1265ea3c1fef22e53f90a475caa04ccaae92cb9 Jul 06 23:48:46.863414 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:46.863342 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="859a02f4-54e7-41f7-be9d-4547cf6a8a11" path="/var/lib/kubelet/pods/859a02f4-54e7-41f7-be9d-4547cf6a8a11/volumes" Jul 06 23:48:47.415737 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:47.415696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" event={"ID":"25917143-35e0-4cb5-bee3-5ae8f9064557","Type":"ContainerStarted","Data":"dd77af2ce117e0328c405decd1265ea3c1fef22e53f90a475caa04ccaae92cb9"} Jul 06 23:48:47.417674 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:47.417641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" event={"ID":"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937","Type":"ContainerStarted","Data":"f2a48cfa161220b458f290fa1ff02f432d03b083eebe5cb368bd52e879e1026e"} Jul 06 23:48:49.429826 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:49.429792 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" event={"ID":"1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937","Type":"ContainerStarted","Data":"7f982f72bc71a6417a51da938112e27495207ad91769f4cb2fcc93cc0967d857"} Jul 06 23:48:49.430160 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:49.429868 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:48:49.459392 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:49.459343 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" podStartSLOduration=2.3826956839999998 podStartE2EDuration="4.459324056s" totalImagesPullingTime="2.076628372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:49.459227684 +0000 UTC m=+321.124402722" watchObservedRunningTime="2026-07-06 23:48:49.459324056 +0000 UTC m=+321.124499095" Jul 06 23:48:50.435503 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:50.435472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" event={"ID":"25917143-35e0-4cb5-bee3-5ae8f9064557","Type":"ContainerStarted","Data":"7facc35dd9643206e81596d2b4807a4891288a4ebe62304d5dee4c23641a1e8b"} Jul 06 23:48:50.455517 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:50.455461 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" podStartSLOduration=2.658029544 podStartE2EDuration="5.455444962s" totalImagesPullingTime="2.797415418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:50.455326031 +0000 UTC m=+322.120501069" watchObservedRunningTime="2026-07-06 23:48:50.455444962 +0000 UTC m=+322.120620001" Jul 06 23:48:51.440766 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:48:51.440739 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:49:20.441475 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:20.441386 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5bsjz" Jul 06 23:49:22.447340 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:22.447301 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-686x8" Jul 06 23:49:51.613318 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.613285 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd"] Jul 06 23:49:51.615647 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.615632 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.618393 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.618375 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 23:49:51.619358 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.619333 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 23:49:51.619441 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.619365 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c6m7v\"" Jul 06 23:49:51.625386 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.625361 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd"] Jul 06 23:49:51.685187 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.685166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.685296 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.685230 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcz8\" (UniqueName: \"kubernetes.io/projected/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-kube-api-access-ztcz8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.685296 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.685265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.785670 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.785644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.785770 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.785690 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcz8\" (UniqueName: \"kubernetes.io/projected/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-kube-api-access-ztcz8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.785770 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.785726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.785975 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.785956 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.786034 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.785984 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.794139 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.794117 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcz8\" (UniqueName: \"kubernetes.io/projected/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-kube-api-access-ztcz8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:51.925803 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:51.925784 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:52.070741 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.070713 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd"] Jul 06 23:49:52.072058 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:49:52.072011 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f9c8c8_5b56_42e9_8e60_48445c9a0aa8.slice/crio-a96dc315e80bed5710819e3dd30cf55ece2d073da4f16f6c29beedb5b1cb8cb5 WatchSource:0}: Error finding container a96dc315e80bed5710819e3dd30cf55ece2d073da4f16f6c29beedb5b1cb8cb5: Status 404 returned error can't find the container with id a96dc315e80bed5710819e3dd30cf55ece2d073da4f16f6c29beedb5b1cb8cb5 Jul 06 23:49:52.223519 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.223486 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq"] Jul 06 23:49:52.226118 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.226100 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.234813 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.234791 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq"] Jul 06 23:49:52.294435 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.294411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6d7\" (UniqueName: \"kubernetes.io/projected/a9dea464-3721-4802-9f6b-8453ef7d32fc-kube-api-access-dr6d7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.294522 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.294453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.294522 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.294505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.395155 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.395133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6d7\" (UniqueName: \"kubernetes.io/projected/a9dea464-3721-4802-9f6b-8453ef7d32fc-kube-api-access-dr6d7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.395258 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.395169 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.395258 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.395213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.395563 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.395544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.395602 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.395559 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.404271 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.404254 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6d7\" (UniqueName: \"kubernetes.io/projected/a9dea464-3721-4802-9f6b-8453ef7d32fc-kube-api-access-dr6d7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.541497 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.541448 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:52.618231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.618184 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts"] Jul 06 23:49:52.621817 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.621794 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.634752 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.634732 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts"] Jul 06 23:49:52.670788 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.670767 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq"] Jul 06 23:49:52.672525 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:49:52.672499 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9dea464_3721_4802_9f6b_8453ef7d32fc.slice/crio-dd79d7e4311b6efac13a0887b12672027c9974a9283a03405e6c5466608cdd2f WatchSource:0}: Error finding container dd79d7e4311b6efac13a0887b12672027c9974a9283a03405e6c5466608cdd2f: Status 404 returned error can't find the container with id dd79d7e4311b6efac13a0887b12672027c9974a9283a03405e6c5466608cdd2f Jul 06 23:49:52.697450 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.697426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x988\" (UniqueName: \"kubernetes.io/projected/5f40c598-3532-4d37-bb45-416815b66819-kube-api-access-7x988\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.697528 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.697463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.697528 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.697524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.734603 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.734568 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" event={"ID":"a9dea464-3721-4802-9f6b-8453ef7d32fc","Type":"ContainerStarted","Data":"2b36e3b41d7bf8d84c6b8ae6766341817a58b1802435a67ed7f2eed96a430665"} Jul 06 23:49:52.734841 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.734809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" event={"ID":"a9dea464-3721-4802-9f6b-8453ef7d32fc","Type":"ContainerStarted","Data":"dd79d7e4311b6efac13a0887b12672027c9974a9283a03405e6c5466608cdd2f"} Jul 06 23:49:52.737211 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.737163 2556 generic.go:356] "Generic (PLEG): container finished" podID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerID="5f3a6881f9250a96f05804f0ba7723d530d3fcfe12f909d34130cfdad94ff550" exitCode=0 Jul 06 23:49:52.737321 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.737254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" event={"ID":"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8","Type":"ContainerDied","Data":"5f3a6881f9250a96f05804f0ba7723d530d3fcfe12f909d34130cfdad94ff550"} Jul 06 23:49:52.737321 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.737309 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" event={"ID":"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8","Type":"ContainerStarted","Data":"a96dc315e80bed5710819e3dd30cf55ece2d073da4f16f6c29beedb5b1cb8cb5"} Jul 06 23:49:52.798360 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.798312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.798466 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.798416 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.798526 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.798501 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x988\" (UniqueName: \"kubernetes.io/projected/5f40c598-3532-4d37-bb45-416815b66819-kube-api-access-7x988\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.798781 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.798758 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.798781 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.798776 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.806696 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.806678 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x988\" (UniqueName: \"kubernetes.io/projected/5f40c598-3532-4d37-bb45-416815b66819-kube-api-access-7x988\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:52.934314 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:52.934298 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:53.020999 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.020970 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs"] Jul 06 23:49:53.026526 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.026508 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.033359 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.032861 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs"] Jul 06 23:49:53.072941 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.072922 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts"] Jul 06 23:49:53.074261 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:49:53.074238 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f40c598_3532_4d37_bb45_416815b66819.slice/crio-ca4dcd33d0e29bec13544351287b9970925bee7c832ad787232159d3a421c7c1 WatchSource:0}: Error finding container ca4dcd33d0e29bec13544351287b9970925bee7c832ad787232159d3a421c7c1: Status 404 returned error can't find the container with id ca4dcd33d0e29bec13544351287b9970925bee7c832ad787232159d3a421c7c1 Jul 06 23:49:53.101134 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.101112 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.101231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.101155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.101280 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.101268 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt4cb\" (UniqueName: \"kubernetes.io/projected/10e12467-a254-44b5-a8fc-fa4d64bf4d52-kube-api-access-vt4cb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.202048 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.202019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.202149 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.202080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt4cb\" (UniqueName: \"kubernetes.io/projected/10e12467-a254-44b5-a8fc-fa4d64bf4d52-kube-api-access-vt4cb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.202149 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.202131 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.202447 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.202426 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.202535 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.202435 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.211779 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.211760 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt4cb\" (UniqueName: \"kubernetes.io/projected/10e12467-a254-44b5-a8fc-fa4d64bf4d52-kube-api-access-vt4cb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.339636 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.339557 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:53.499034 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.499013 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs"] Jul 06 23:49:53.535927 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:49:53.535903 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e12467_a254_44b5_a8fc_fa4d64bf4d52.slice/crio-f4fb079722ac5658ffddd64b108a951f2265ebb21d3872f9d0e0b580fb88f948 WatchSource:0}: Error finding container f4fb079722ac5658ffddd64b108a951f2265ebb21d3872f9d0e0b580fb88f948: Status 404 returned error can't find the container with id f4fb079722ac5658ffddd64b108a951f2265ebb21d3872f9d0e0b580fb88f948 Jul 06 23:49:53.743595 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.743575 2556 generic.go:356] "Generic (PLEG): container finished" podID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerID="1f8818aa42e9664c65545a922f6d524706d58cb984e0a00a9fe35875c28772e6" exitCode=0 Jul 06 23:49:53.743964 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.743668 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" event={"ID":"10e12467-a254-44b5-a8fc-fa4d64bf4d52","Type":"ContainerDied","Data":"1f8818aa42e9664c65545a922f6d524706d58cb984e0a00a9fe35875c28772e6"} Jul 06 23:49:53.743964 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.743716 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" event={"ID":"10e12467-a254-44b5-a8fc-fa4d64bf4d52","Type":"ContainerStarted","Data":"f4fb079722ac5658ffddd64b108a951f2265ebb21d3872f9d0e0b580fb88f948"} Jul 06 23:49:53.745366 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.745334 2556 generic.go:356] "Generic (PLEG): container finished" podID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerID="2b36e3b41d7bf8d84c6b8ae6766341817a58b1802435a67ed7f2eed96a430665" exitCode=0 Jul 06 23:49:53.745458 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.745418 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" event={"ID":"a9dea464-3721-4802-9f6b-8453ef7d32fc","Type":"ContainerDied","Data":"2b36e3b41d7bf8d84c6b8ae6766341817a58b1802435a67ed7f2eed96a430665"} Jul 06 23:49:53.746988 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.746969 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f40c598-3532-4d37-bb45-416815b66819" containerID="23a42ab85cfd93aef442309b82791a0959508dd5d7092e37c8905933c0067cd4" exitCode=0 Jul 06 23:49:53.747118 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.746993 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" event={"ID":"5f40c598-3532-4d37-bb45-416815b66819","Type":"ContainerDied","Data":"23a42ab85cfd93aef442309b82791a0959508dd5d7092e37c8905933c0067cd4"} Jul 06 23:49:53.747118 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.747034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" event={"ID":"5f40c598-3532-4d37-bb45-416815b66819","Type":"ContainerStarted","Data":"ca4dcd33d0e29bec13544351287b9970925bee7c832ad787232159d3a421c7c1"} Jul 06 23:49:53.749265 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.749243 2556 generic.go:356] "Generic (PLEG): container finished" podID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerID="7ec72c2c8458780f52ceac388bd676fcf7935789137a61aba2dc0fc1869e93cd" exitCode=0 Jul 06 23:49:53.749354 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:53.749284 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" event={"ID":"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8","Type":"ContainerDied","Data":"7ec72c2c8458780f52ceac388bd676fcf7935789137a61aba2dc0fc1869e93cd"} Jul 06 23:49:54.755690 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.755664 2556 generic.go:356] "Generic (PLEG): container finished" podID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerID="018e5f5c9b706d4627f2c7926965dd5064cb37098fc8b323957a0366b3c6e1f4" exitCode=0 Jul 06 23:49:54.756084 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.755733 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" event={"ID":"a9dea464-3721-4802-9f6b-8453ef7d32fc","Type":"ContainerDied","Data":"018e5f5c9b706d4627f2c7926965dd5064cb37098fc8b323957a0366b3c6e1f4"} Jul 06 23:49:54.757699 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.757680 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f40c598-3532-4d37-bb45-416815b66819" containerID="e6be73243c5e5934983c336052a4c1b0dad5b223e7bdde7328bde643b2de4cb2" exitCode=0 Jul 06 23:49:54.757780 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.757734 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" event={"ID":"5f40c598-3532-4d37-bb45-416815b66819","Type":"ContainerDied","Data":"e6be73243c5e5934983c336052a4c1b0dad5b223e7bdde7328bde643b2de4cb2"} Jul 06 23:49:54.765801 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.765781 2556 generic.go:356] "Generic (PLEG): container finished" podID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerID="e3fa4d78a687dc2f47062476420df4e56b43d9d15769ad932ebf9730b1d1e8d0" exitCode=0 Jul 06 23:49:54.765913 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.765848 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" event={"ID":"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8","Type":"ContainerDied","Data":"e3fa4d78a687dc2f47062476420df4e56b43d9d15769ad932ebf9730b1d1e8d0"} Jul 06 23:49:54.767961 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.767944 2556 generic.go:356] "Generic (PLEG): container finished" podID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerID="d410be314d5c436e771bfa97e38450ba30fe0be3736014a50488f166f5c847e1" exitCode=0 Jul 06 23:49:54.768061 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:54.767993 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" event={"ID":"10e12467-a254-44b5-a8fc-fa4d64bf4d52","Type":"ContainerDied","Data":"d410be314d5c436e771bfa97e38450ba30fe0be3736014a50488f166f5c847e1"} Jul 06 23:49:55.774728 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:55.774689 2556 generic.go:356] "Generic (PLEG): container finished" podID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerID="56e3f4cfd916a56501160da2185ac02d0c0ca07f5879d24617c6d01df7d01fec" exitCode=0 Jul 06 23:49:55.775085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:55.774773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" event={"ID":"a9dea464-3721-4802-9f6b-8453ef7d32fc","Type":"ContainerDied","Data":"56e3f4cfd916a56501160da2185ac02d0c0ca07f5879d24617c6d01df7d01fec"} Jul 06 23:49:55.776659 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:55.776637 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f40c598-3532-4d37-bb45-416815b66819" containerID="d7a62b129d0fe51a63cc223eee6026282c8a0bd18f8e9dda5f11bbe29cd946cb" exitCode=0 Jul 06 23:49:55.776758 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:55.776713 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" event={"ID":"5f40c598-3532-4d37-bb45-416815b66819","Type":"ContainerDied","Data":"d7a62b129d0fe51a63cc223eee6026282c8a0bd18f8e9dda5f11bbe29cd946cb"} Jul 06 23:49:55.778526 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:55.778507 2556 generic.go:356] "Generic (PLEG): container finished" podID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerID="7c9bc075802789ebf9e6182d79a8b6062086e7b4565d34112a17e5979037e52f" exitCode=0 Jul 06 23:49:55.778622 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:55.778553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" event={"ID":"10e12467-a254-44b5-a8fc-fa4d64bf4d52","Type":"ContainerDied","Data":"7c9bc075802789ebf9e6182d79a8b6062086e7b4565d34112a17e5979037e52f"} Jul 06 23:49:55.908188 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:55.908165 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:56.021796 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.021772 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-bundle\") pod \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " Jul 06 23:49:56.021937 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.021848 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztcz8\" (UniqueName: \"kubernetes.io/projected/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-kube-api-access-ztcz8\") pod \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " Jul 06 23:49:56.021937 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.021884 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-util\") pod \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\" (UID: \"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8\") " Jul 06 23:49:56.022298 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.022274 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-bundle" (OuterVolumeSpecName: "bundle") pod "79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" (UID: "79f9c8c8-5b56-42e9-8e60-48445c9a0aa8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:56.024000 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.023975 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-kube-api-access-ztcz8" (OuterVolumeSpecName: "kube-api-access-ztcz8") pod "79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" (UID: "79f9c8c8-5b56-42e9-8e60-48445c9a0aa8"). InnerVolumeSpecName "kube-api-access-ztcz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:56.027886 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.027841 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-util" (OuterVolumeSpecName: "util") pod "79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" (UID: "79f9c8c8-5b56-42e9-8e60-48445c9a0aa8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:56.123006 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.122981 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-util\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:56.123006 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.123002 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:56.123115 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.123014 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztcz8\" (UniqueName: \"kubernetes.io/projected/79f9c8c8-5b56-42e9-8e60-48445c9a0aa8-kube-api-access-ztcz8\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:56.785701 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.785680 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" Jul 06 23:49:56.786014 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.785710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd" event={"ID":"79f9c8c8-5b56-42e9-8e60-48445c9a0aa8","Type":"ContainerDied","Data":"a96dc315e80bed5710819e3dd30cf55ece2d073da4f16f6c29beedb5b1cb8cb5"} Jul 06 23:49:56.786014 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.785758 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a96dc315e80bed5710819e3dd30cf55ece2d073da4f16f6c29beedb5b1cb8cb5" Jul 06 23:49:56.927509 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.927483 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:56.928096 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.928073 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x988\" (UniqueName: \"kubernetes.io/projected/5f40c598-3532-4d37-bb45-416815b66819-kube-api-access-7x988\") pod \"5f40c598-3532-4d37-bb45-416815b66819\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " Jul 06 23:49:56.928226 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.928134 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-util\") pod \"5f40c598-3532-4d37-bb45-416815b66819\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " Jul 06 23:49:56.933098 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.933065 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f40c598-3532-4d37-bb45-416815b66819-kube-api-access-7x988" (OuterVolumeSpecName: "kube-api-access-7x988") pod "5f40c598-3532-4d37-bb45-416815b66819" (UID: "5f40c598-3532-4d37-bb45-416815b66819"). InnerVolumeSpecName "kube-api-access-7x988". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:56.934484 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.934463 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-util" (OuterVolumeSpecName: "util") pod "5f40c598-3532-4d37-bb45-416815b66819" (UID: "5f40c598-3532-4d37-bb45-416815b66819"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:56.975278 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.975257 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:56.977246 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:56.977228 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:57.029391 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029370 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-bundle\") pod \"5f40c598-3532-4d37-bb45-416815b66819\" (UID: \"5f40c598-3532-4d37-bb45-416815b66819\") " Jul 06 23:49:57.029522 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029404 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr6d7\" (UniqueName: \"kubernetes.io/projected/a9dea464-3721-4802-9f6b-8453ef7d32fc-kube-api-access-dr6d7\") pod \"a9dea464-3721-4802-9f6b-8453ef7d32fc\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " Jul 06 23:49:57.029522 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029421 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-bundle\") pod \"a9dea464-3721-4802-9f6b-8453ef7d32fc\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " Jul 06 23:49:57.029522 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029465 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt4cb\" (UniqueName: \"kubernetes.io/projected/10e12467-a254-44b5-a8fc-fa4d64bf4d52-kube-api-access-vt4cb\") pod \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " Jul 06 23:49:57.029522 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029494 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-bundle\") pod \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " Jul 06 23:49:57.029735 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029524 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-util\") pod \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\" (UID: \"10e12467-a254-44b5-a8fc-fa4d64bf4d52\") " Jul 06 23:49:57.029735 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029552 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-util\") pod \"a9dea464-3721-4802-9f6b-8453ef7d32fc\" (UID: \"a9dea464-3721-4802-9f6b-8453ef7d32fc\") " Jul 06 23:49:57.029835 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029783 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x988\" (UniqueName: \"kubernetes.io/projected/5f40c598-3532-4d37-bb45-416815b66819-kube-api-access-7x988\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.029835 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.029800 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-util\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.030167 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.030141 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-bundle" (OuterVolumeSpecName: "bundle") pod "10e12467-a254-44b5-a8fc-fa4d64bf4d52" (UID: "10e12467-a254-44b5-a8fc-fa4d64bf4d52"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:57.030331 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.030261 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-bundle" (OuterVolumeSpecName: "bundle") pod "a9dea464-3721-4802-9f6b-8453ef7d32fc" (UID: "a9dea464-3721-4802-9f6b-8453ef7d32fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:57.030726 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.030698 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-bundle" (OuterVolumeSpecName: "bundle") pod "5f40c598-3532-4d37-bb45-416815b66819" (UID: "5f40c598-3532-4d37-bb45-416815b66819"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:57.032001 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.031972 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9dea464-3721-4802-9f6b-8453ef7d32fc-kube-api-access-dr6d7" (OuterVolumeSpecName: "kube-api-access-dr6d7") pod "a9dea464-3721-4802-9f6b-8453ef7d32fc" (UID: "a9dea464-3721-4802-9f6b-8453ef7d32fc"). InnerVolumeSpecName "kube-api-access-dr6d7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:57.032107 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.032051 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10e12467-a254-44b5-a8fc-fa4d64bf4d52-kube-api-access-vt4cb" (OuterVolumeSpecName: "kube-api-access-vt4cb") pod "10e12467-a254-44b5-a8fc-fa4d64bf4d52" (UID: "10e12467-a254-44b5-a8fc-fa4d64bf4d52"). InnerVolumeSpecName "kube-api-access-vt4cb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:57.035731 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.035687 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-util" (OuterVolumeSpecName: "util") pod "10e12467-a254-44b5-a8fc-fa4d64bf4d52" (UID: "10e12467-a254-44b5-a8fc-fa4d64bf4d52"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:57.039846 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.039821 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-util" (OuterVolumeSpecName: "util") pod "a9dea464-3721-4802-9f6b-8453ef7d32fc" (UID: "a9dea464-3721-4802-9f6b-8453ef7d32fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:57.131085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.131062 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f40c598-3532-4d37-bb45-416815b66819-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.131085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.131086 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr6d7\" (UniqueName: \"kubernetes.io/projected/a9dea464-3721-4802-9f6b-8453ef7d32fc-kube-api-access-dr6d7\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.131300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.131100 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.131300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.131116 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt4cb\" (UniqueName: \"kubernetes.io/projected/10e12467-a254-44b5-a8fc-fa4d64bf4d52-kube-api-access-vt4cb\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.131300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.131129 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.131300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.131140 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10e12467-a254-44b5-a8fc-fa4d64bf4d52-util\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.131300 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.131150 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9dea464-3721-4802-9f6b-8453ef7d32fc-util\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:49:57.792074 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.792045 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" Jul 06 23:49:57.792455 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.792062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts" event={"ID":"5f40c598-3532-4d37-bb45-416815b66819","Type":"ContainerDied","Data":"ca4dcd33d0e29bec13544351287b9970925bee7c832ad787232159d3a421c7c1"} Jul 06 23:49:57.792455 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.792145 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca4dcd33d0e29bec13544351287b9970925bee7c832ad787232159d3a421c7c1" Jul 06 23:49:57.793930 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.793917 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" Jul 06 23:49:57.794037 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.793949 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs" event={"ID":"10e12467-a254-44b5-a8fc-fa4d64bf4d52","Type":"ContainerDied","Data":"f4fb079722ac5658ffddd64b108a951f2265ebb21d3872f9d0e0b580fb88f948"} Jul 06 23:49:57.794037 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.793983 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4fb079722ac5658ffddd64b108a951f2265ebb21d3872f9d0e0b580fb88f948" Jul 06 23:49:57.795793 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.795771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" event={"ID":"a9dea464-3721-4802-9f6b-8453ef7d32fc","Type":"ContainerDied","Data":"dd79d7e4311b6efac13a0887b12672027c9974a9283a03405e6c5466608cdd2f"} Jul 06 23:49:57.795793 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.795788 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq" Jul 06 23:49:57.795915 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:49:57.795810 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd79d7e4311b6efac13a0887b12672027c9974a9283a03405e6c5466608cdd2f" Jul 06 23:50:08.731619 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.731589 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf"] Jul 06 23:50:08.732077 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732056 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerName="pull" Jul 06 23:50:08.732077 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732072 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerName="pull" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732094 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerName="util" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732101 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerName="util" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732112 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerName="extract" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732121 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerName="extract" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732133 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerName="extract" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732141 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerName="extract" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732149 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f40c598-3532-4d37-bb45-416815b66819" containerName="extract" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732157 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f40c598-3532-4d37-bb45-416815b66819" containerName="extract" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732177 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerName="pull" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732185 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerName="pull" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732212 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerName="pull" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732219 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerName="pull" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732227 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f40c598-3532-4d37-bb45-416815b66819" containerName="pull" Jul 06 23:50:08.732231 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732236 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f40c598-3532-4d37-bb45-416815b66819" containerName="pull" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732252 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f40c598-3532-4d37-bb45-416815b66819" containerName="util" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732260 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f40c598-3532-4d37-bb45-416815b66819" containerName="util" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732273 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerName="util" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732281 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerName="util" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732292 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerName="util" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732300 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerName="util" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732309 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerName="extract" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732317 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerName="extract" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732420 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9dea464-3721-4802-9f6b-8453ef7d32fc" containerName="extract" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732436 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="10e12467-a254-44b5-a8fc-fa4d64bf4d52" containerName="extract" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732446 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="79f9c8c8-5b56-42e9-8e60-48445c9a0aa8" containerName="extract" Jul 06 23:50:08.732879 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.732458 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f40c598-3532-4d37-bb45-416815b66819" containerName="extract" Jul 06 23:50:08.737262 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.737243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:08.740307 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.740289 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 23:50:08.740403 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.740313 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 23:50:08.740742 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.740727 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z9kl7\"" Jul 06 23:50:08.749968 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.749949 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf"] Jul 06 23:50:08.812895 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.812876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkl6j\" (UniqueName: \"kubernetes.io/projected/051d3430-def1-4529-a2db-8148d20583be-kube-api-access-lkl6j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:08.813010 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.812953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/051d3430-def1-4529-a2db-8148d20583be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:08.913810 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.913790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkl6j\" (UniqueName: \"kubernetes.io/projected/051d3430-def1-4529-a2db-8148d20583be-kube-api-access-lkl6j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:08.913925 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.913844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/051d3430-def1-4529-a2db-8148d20583be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:08.914108 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.914094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/051d3430-def1-4529-a2db-8148d20583be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:08.925666 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:08.925650 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkl6j\" (UniqueName: \"kubernetes.io/projected/051d3430-def1-4529-a2db-8148d20583be-kube-api-access-lkl6j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:09.046977 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:09.046926 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:09.199398 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:09.199369 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf"] Jul 06 23:50:09.214668 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:50:09.214642 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051d3430_def1_4529_a2db_8148d20583be.slice/crio-f9440b16f2b933301f5bc947eea959af432e890d5773313cacc059088695f829 WatchSource:0}: Error finding container f9440b16f2b933301f5bc947eea959af432e890d5773313cacc059088695f829: Status 404 returned error can't find the container with id f9440b16f2b933301f5bc947eea959af432e890d5773313cacc059088695f829 Jul 06 23:50:09.861992 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:09.861945 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" event={"ID":"051d3430-def1-4529-a2db-8148d20583be","Type":"ContainerStarted","Data":"f9440b16f2b933301f5bc947eea959af432e890d5773313cacc059088695f829"} Jul 06 23:50:11.937235 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:11.937186 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz"] Jul 06 23:50:11.940388 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:11.940370 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" Jul 06 23:50:11.942948 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:11.942928 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 23:50:11.943687 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:11.943671 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-95ldd\"" Jul 06 23:50:11.956469 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:11.956447 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz"] Jul 06 23:50:12.041376 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:12.041354 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t4wb\" (UniqueName: \"kubernetes.io/projected/ed4d2e7c-47f6-445e-86c8-bc85e3140092-kube-api-access-6t4wb\") pod \"dns-operator-controller-manager-864dd78c4c-xgdrz\" (UID: \"ed4d2e7c-47f6-445e-86c8-bc85e3140092\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" Jul 06 23:50:12.142725 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:12.142694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t4wb\" (UniqueName: \"kubernetes.io/projected/ed4d2e7c-47f6-445e-86c8-bc85e3140092-kube-api-access-6t4wb\") pod \"dns-operator-controller-manager-864dd78c4c-xgdrz\" (UID: \"ed4d2e7c-47f6-445e-86c8-bc85e3140092\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" Jul 06 23:50:12.153707 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:12.153680 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t4wb\" (UniqueName: \"kubernetes.io/projected/ed4d2e7c-47f6-445e-86c8-bc85e3140092-kube-api-access-6t4wb\") pod \"dns-operator-controller-manager-864dd78c4c-xgdrz\" (UID: \"ed4d2e7c-47f6-445e-86c8-bc85e3140092\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" Jul 06 23:50:12.251311 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:12.251255 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" Jul 06 23:50:12.415079 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:12.415054 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz"] Jul 06 23:50:12.416703 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:50:12.416666 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4d2e7c_47f6_445e_86c8_bc85e3140092.slice/crio-ef43f1ee91977c25e04097511a4d389f140f0d87429171cb53cc8955bbaaf9e1 WatchSource:0}: Error finding container ef43f1ee91977c25e04097511a4d389f140f0d87429171cb53cc8955bbaaf9e1: Status 404 returned error can't find the container with id ef43f1ee91977c25e04097511a4d389f140f0d87429171cb53cc8955bbaaf9e1 Jul 06 23:50:12.881713 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:12.881672 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" event={"ID":"ed4d2e7c-47f6-445e-86c8-bc85e3140092","Type":"ContainerStarted","Data":"ef43f1ee91977c25e04097511a4d389f140f0d87429171cb53cc8955bbaaf9e1"} Jul 06 23:50:14.556996 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.556965 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt"] Jul 06 23:50:14.562095 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.562074 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:14.564639 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.564621 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8rx4g\"" Jul 06 23:50:14.573577 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.573554 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt"] Jul 06 23:50:14.665725 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.665689 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzl89\" (UniqueName: \"kubernetes.io/projected/4914e17a-04d6-45a6-8797-51094372216c-kube-api-access-dzl89\") pod \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" (UID: \"4914e17a-04d6-45a6-8797-51094372216c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:14.766273 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.766183 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzl89\" (UniqueName: \"kubernetes.io/projected/4914e17a-04d6-45a6-8797-51094372216c-kube-api-access-dzl89\") pod \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" (UID: \"4914e17a-04d6-45a6-8797-51094372216c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:14.777838 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.777814 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzl89\" (UniqueName: \"kubernetes.io/projected/4914e17a-04d6-45a6-8797-51094372216c-kube-api-access-dzl89\") pod \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" (UID: \"4914e17a-04d6-45a6-8797-51094372216c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:14.873867 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:14.873827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:15.203263 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.203175 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt"] Jul 06 23:50:15.205166 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:50:15.205142 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4914e17a_04d6_45a6_8797_51094372216c.slice/crio-5a624720dbe95d03706103bb335fecc97e31c73d31838fe281c559b05ad04418 WatchSource:0}: Error finding container 5a624720dbe95d03706103bb335fecc97e31c73d31838fe281c559b05ad04418: Status 404 returned error can't find the container with id 5a624720dbe95d03706103bb335fecc97e31c73d31838fe281c559b05ad04418 Jul 06 23:50:15.901501 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.901464 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" event={"ID":"4914e17a-04d6-45a6-8797-51094372216c","Type":"ContainerStarted","Data":"5a624720dbe95d03706103bb335fecc97e31c73d31838fe281c559b05ad04418"} Jul 06 23:50:15.903411 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.903380 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" event={"ID":"051d3430-def1-4529-a2db-8148d20583be","Type":"ContainerStarted","Data":"a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28"} Jul 06 23:50:15.903550 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.903434 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:15.904845 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.904816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" event={"ID":"ed4d2e7c-47f6-445e-86c8-bc85e3140092","Type":"ContainerStarted","Data":"155be9a4c7f3285c5c129865f8007d0099a90e909abf615d02ad77a34a81af37"} Jul 06 23:50:15.904949 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.904937 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" Jul 06 23:50:15.931990 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.931937 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" podStartSLOduration=2.081936226 podStartE2EDuration="7.931917794s" totalImagesPullingTime="5.849981568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:15.929955014 +0000 UTC m=+407.595130053" watchObservedRunningTime="2026-07-06 23:50:15.931917794 +0000 UTC m=+407.597092831" Jul 06 23:50:15.955375 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:15.955328 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" podStartSLOduration=2.253044711 podStartE2EDuration="4.955314342s" totalImagesPullingTime="2.702269631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:15.953491179 +0000 UTC m=+407.618666235" watchObservedRunningTime="2026-07-06 23:50:15.955314342 +0000 UTC m=+407.620489380" Jul 06 23:50:16.912713 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:16.912615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" event={"ID":"4914e17a-04d6-45a6-8797-51094372216c","Type":"ContainerStarted","Data":"afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77"} Jul 06 23:50:16.913131 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:16.912997 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:16.958593 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:16.958501 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" podStartSLOduration=1.4711373939999999 podStartE2EDuration="2.95848832s" totalImagesPullingTime="1.487350926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:16.954968898 +0000 UTC m=+408.620143950" watchObservedRunningTime="2026-07-06 23:50:16.95848832 +0000 UTC m=+408.623663357" Jul 06 23:50:26.914647 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:26.914619 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:26.915109 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:26.914684 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xgdrz" Jul 06 23:50:28.925280 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:28.925255 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.083154 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.083126 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf"] Jul 06 23:50:29.083348 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.083312 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" podUID="051d3430-def1-4529-a2db-8148d20583be" containerName="manager" containerID="cri-o://a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28" gracePeriod=2 Jul 06 23:50:29.089810 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.089782 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf"] Jul 06 23:50:29.109243 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.109216 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt"] Jul 06 23:50:29.109437 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.109395 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" podUID="4914e17a-04d6-45a6-8797-51094372216c" containerName="manager" containerID="cri-o://afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77" gracePeriod=2 Jul 06 23:50:29.112519 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.112486 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="051d3430-def1-4529-a2db-8148d20583be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:29.134091 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.134065 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt"] Jul 06 23:50:29.138728 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.138698 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4914e17a-04d6-45a6-8797-51094372216c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-hdqnt\": pods \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.147783 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.147761 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2"] Jul 06 23:50:29.148089 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.148075 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="051d3430-def1-4529-a2db-8148d20583be" containerName="manager" Jul 06 23:50:29.148089 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.148090 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="051d3430-def1-4529-a2db-8148d20583be" containerName="manager" Jul 06 23:50:29.148249 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.148098 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4914e17a-04d6-45a6-8797-51094372216c" containerName="manager" Jul 06 23:50:29.148249 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.148103 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4914e17a-04d6-45a6-8797-51094372216c" containerName="manager" Jul 06 23:50:29.148249 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.148184 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="051d3430-def1-4529-a2db-8148d20583be" containerName="manager" Jul 06 23:50:29.148249 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.148215 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4914e17a-04d6-45a6-8797-51094372216c" containerName="manager" Jul 06 23:50:29.151554 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.151535 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.153746 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.153724 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="051d3430-def1-4529-a2db-8148d20583be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:29.155667 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.155640 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="4914e17a-04d6-45a6-8797-51094372216c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.168481 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.168461 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx"] Jul 06 23:50:29.172222 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.172184 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" Jul 06 23:50:29.173142 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.173123 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2"] Jul 06 23:50:29.186593 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.186538 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx"] Jul 06 23:50:29.222842 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.222802 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="051d3430-def1-4529-a2db-8148d20583be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:29.225079 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.225047 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="4914e17a-04d6-45a6-8797-51094372216c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.282055 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.282028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd6d22e7-d338-4175-8d03-1416762443a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2xl2\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.282235 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.282066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7sfr\" (UniqueName: \"kubernetes.io/projected/dd6d22e7-d338-4175-8d03-1416762443a9-kube-api-access-p7sfr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2xl2\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.282235 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.282105 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlkpc\" (UniqueName: \"kubernetes.io/projected/bcd47fe3-6833-4d14-afdf-bece4035c50e-kube-api-access-qlkpc\") pod \"limitador-operator-controller-manager-859d7b78bd-6qcqx\" (UID: \"bcd47fe3-6833-4d14-afdf-bece4035c50e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" Jul 06 23:50:29.361840 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.361819 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.364360 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.364336 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="051d3430-def1-4529-a2db-8148d20583be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:29.364566 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.364552 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:29.366612 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.366587 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="4914e17a-04d6-45a6-8797-51094372216c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.371103 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.371083 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="051d3430-def1-4529-a2db-8148d20583be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:29.373930 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:29.373909 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="4914e17a-04d6-45a6-8797-51094372216c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.382958 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.382937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7sfr\" (UniqueName: \"kubernetes.io/projected/dd6d22e7-d338-4175-8d03-1416762443a9-kube-api-access-p7sfr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2xl2\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.383051 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.382999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlkpc\" (UniqueName: \"kubernetes.io/projected/bcd47fe3-6833-4d14-afdf-bece4035c50e-kube-api-access-qlkpc\") pod \"limitador-operator-controller-manager-859d7b78bd-6qcqx\" (UID: \"bcd47fe3-6833-4d14-afdf-bece4035c50e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" Jul 06 23:50:29.383126 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.383112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd6d22e7-d338-4175-8d03-1416762443a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2xl2\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.383484 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.383467 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd6d22e7-d338-4175-8d03-1416762443a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2xl2\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.395526 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.395502 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlkpc\" (UniqueName: \"kubernetes.io/projected/bcd47fe3-6833-4d14-afdf-bece4035c50e-kube-api-access-qlkpc\") pod \"limitador-operator-controller-manager-859d7b78bd-6qcqx\" (UID: \"bcd47fe3-6833-4d14-afdf-bece4035c50e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" Jul 06 23:50:29.395604 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.395532 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7sfr\" (UniqueName: \"kubernetes.io/projected/dd6d22e7-d338-4175-8d03-1416762443a9-kube-api-access-p7sfr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2xl2\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.484085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.484030 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/051d3430-def1-4529-a2db-8148d20583be-extensions-socket-volume\") pod \"051d3430-def1-4529-a2db-8148d20583be\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " Jul 06 23:50:29.484085 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.484075 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzl89\" (UniqueName: \"kubernetes.io/projected/4914e17a-04d6-45a6-8797-51094372216c-kube-api-access-dzl89\") pod \"4914e17a-04d6-45a6-8797-51094372216c\" (UID: \"4914e17a-04d6-45a6-8797-51094372216c\") " Jul 06 23:50:29.484241 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.484137 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkl6j\" (UniqueName: \"kubernetes.io/projected/051d3430-def1-4529-a2db-8148d20583be-kube-api-access-lkl6j\") pod \"051d3430-def1-4529-a2db-8148d20583be\" (UID: \"051d3430-def1-4529-a2db-8148d20583be\") " Jul 06 23:50:29.484446 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.484410 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/051d3430-def1-4529-a2db-8148d20583be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "051d3430-def1-4529-a2db-8148d20583be" (UID: "051d3430-def1-4529-a2db-8148d20583be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:50:29.486309 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.486285 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/051d3430-def1-4529-a2db-8148d20583be-kube-api-access-lkl6j" (OuterVolumeSpecName: "kube-api-access-lkl6j") pod "051d3430-def1-4529-a2db-8148d20583be" (UID: "051d3430-def1-4529-a2db-8148d20583be"). InnerVolumeSpecName "kube-api-access-lkl6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:50:29.486404 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.486350 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4914e17a-04d6-45a6-8797-51094372216c-kube-api-access-dzl89" (OuterVolumeSpecName: "kube-api-access-dzl89") pod "4914e17a-04d6-45a6-8797-51094372216c" (UID: "4914e17a-04d6-45a6-8797-51094372216c"). InnerVolumeSpecName "kube-api-access-dzl89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:50:29.521035 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.521009 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.527941 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.527918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" Jul 06 23:50:29.586928 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.586795 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkl6j\" (UniqueName: \"kubernetes.io/projected/051d3430-def1-4529-a2db-8148d20583be-kube-api-access-lkl6j\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:50:29.586928 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.586829 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/051d3430-def1-4529-a2db-8148d20583be-extensions-socket-volume\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:50:29.586928 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.586845 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzl89\" (UniqueName: \"kubernetes.io/projected/4914e17a-04d6-45a6-8797-51094372216c-kube-api-access-dzl89\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:50:29.675428 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.675404 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2"] Jul 06 23:50:29.677246 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:50:29.677219 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6d22e7_d338_4175_8d03_1416762443a9.slice/crio-f18336cace11bdfa7baaf5c2b682da1de6db1dc27970e9e23dea4b8c3900cf35 WatchSource:0}: Error finding container f18336cace11bdfa7baaf5c2b682da1de6db1dc27970e9e23dea4b8c3900cf35: Status 404 returned error can't find the container with id f18336cace11bdfa7baaf5c2b682da1de6db1dc27970e9e23dea4b8c3900cf35 Jul 06 23:50:29.698755 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.698735 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx"] Jul 06 23:50:29.713346 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:50:29.713316 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd47fe3_6833_4d14_afdf_bece4035c50e.slice/crio-e14070481a898d59e14c41c9ec91a8309276a7151599c046c301a21267b0225b WatchSource:0}: Error finding container e14070481a898d59e14c41c9ec91a8309276a7151599c046c301a21267b0225b: Status 404 returned error can't find the container with id e14070481a898d59e14c41c9ec91a8309276a7151599c046c301a21267b0225b Jul 06 23:50:29.981260 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.981229 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" event={"ID":"dd6d22e7-d338-4175-8d03-1416762443a9","Type":"ContainerStarted","Data":"5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4"} Jul 06 23:50:29.981708 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.981293 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" event={"ID":"dd6d22e7-d338-4175-8d03-1416762443a9","Type":"ContainerStarted","Data":"f18336cace11bdfa7baaf5c2b682da1de6db1dc27970e9e23dea4b8c3900cf35"} Jul 06 23:50:29.981708 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.981323 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:29.982809 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.982783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" event={"ID":"bcd47fe3-6833-4d14-afdf-bece4035c50e","Type":"ContainerStarted","Data":"dbfa0fa6ebcd4a62623439a76d2b04d3dc00192e1975e3cfe8d7c7a0b1b84ef9"} Jul 06 23:50:29.982930 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.982832 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" event={"ID":"bcd47fe3-6833-4d14-afdf-bece4035c50e","Type":"ContainerStarted","Data":"e14070481a898d59e14c41c9ec91a8309276a7151599c046c301a21267b0225b"} Jul 06 23:50:29.982930 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.982868 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" Jul 06 23:50:29.983973 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.983952 2556 generic.go:356] "Generic (PLEG): container finished" podID="4914e17a-04d6-45a6-8797-51094372216c" containerID="afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77" exitCode=0 Jul 06 23:50:29.984079 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.983988 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:29.990446 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.984445 2556 scope.go:117] "RemoveContainer" containerID="afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77" Jul 06 23:50:29.992458 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.992432 2556 generic.go:356] "Generic (PLEG): container finished" podID="051d3430-def1-4529-a2db-8148d20583be" containerID="a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28" exitCode=0 Jul 06 23:50:29.992555 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:29.992484 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:30.001331 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.001312 2556 scope.go:117] "RemoveContainer" containerID="afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77" Jul 06 23:50:30.001605 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:30.001575 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77\": container with ID starting with afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77 not found: ID does not exist" containerID="afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77" Jul 06 23:50:30.001714 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.001604 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77"} err="failed to get container status \"afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77\": rpc error: code = NotFound desc = could not find container \"afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77\": container with ID starting with afd459bd010ac56561319b9b7a51e691d96c2537eb3d5a768ebf2c6cb19b8c77 not found: ID does not exist" Jul 06 23:50:30.001714 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.001622 2556 scope.go:117] "RemoveContainer" containerID="a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28" Jul 06 23:50:30.009185 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.009166 2556 scope.go:117] "RemoveContainer" containerID="a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28" Jul 06 23:50:30.009435 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:30.009418 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28\": container with ID starting with a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28 not found: ID does not exist" containerID="a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28" Jul 06 23:50:30.009487 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.009442 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28"} err="failed to get container status \"a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28\": rpc error: code = NotFound desc = could not find container \"a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28\": container with ID starting with a6e656bec4b361739f7bf99c68163e3b44cc380703859babb4a1302a0222ef28 not found: ID does not exist" Jul 06 23:50:30.027318 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:30.027287 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="051d3430-def1-4529-a2db-8148d20583be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:30.027492 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.027458 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" podStartSLOduration=1.027447475 podStartE2EDuration="1.027447475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:30.024880568 +0000 UTC m=+421.690055619" watchObservedRunningTime="2026-07-06 23:50:30.027447475 +0000 UTC m=+421.692622514" Jul 06 23:50:30.029638 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:30.029608 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="4914e17a-04d6-45a6-8797-51094372216c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:30.031829 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:30.031807 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mh7jf\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="051d3430-def1-4529-a2db-8148d20583be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh7jf" Jul 06 23:50:30.033935 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:30.033915 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hdqnt\" is forbidden: User \"system:node:ip-10-0-135-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-156.ec2.internal' and this object" podUID="4914e17a-04d6-45a6-8797-51094372216c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hdqnt" Jul 06 23:50:30.068346 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.068299 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" podStartSLOduration=1.068283352 podStartE2EDuration="1.068283352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:30.063968837 +0000 UTC m=+421.729143875" watchObservedRunningTime="2026-07-06 23:50:30.068283352 +0000 UTC m=+421.733458391" Jul 06 23:50:30.864564 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.864529 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="051d3430-def1-4529-a2db-8148d20583be" path="/var/lib/kubelet/pods/051d3430-def1-4529-a2db-8148d20583be/volumes" Jul 06 23:50:30.864846 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:30.864834 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4914e17a-04d6-45a6-8797-51094372216c" path="/var/lib/kubelet/pods/4914e17a-04d6-45a6-8797-51094372216c/volumes" Jul 06 23:50:41.001953 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:41.001920 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:41.002409 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:41.002000 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qcqx" Jul 06 23:50:45.021806 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.021776 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2"] Jul 06 23:50:45.022170 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.021991 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" podUID="dd6d22e7-d338-4175-8d03-1416762443a9" containerName="manager" containerID="cri-o://5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4" gracePeriod=10 Jul 06 23:50:45.263683 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.263659 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:45.289776 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.289724 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f"] Jul 06 23:50:45.290060 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.290049 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6d22e7-d338-4175-8d03-1416762443a9" containerName="manager" Jul 06 23:50:45.290110 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.290062 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6d22e7-d338-4175-8d03-1416762443a9" containerName="manager" Jul 06 23:50:45.290149 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.290129 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd6d22e7-d338-4175-8d03-1416762443a9" containerName="manager" Jul 06 23:50:45.292998 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.292984 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.308422 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.308396 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f"] Jul 06 23:50:45.416232 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.416181 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd6d22e7-d338-4175-8d03-1416762443a9-extensions-socket-volume\") pod \"dd6d22e7-d338-4175-8d03-1416762443a9\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " Jul 06 23:50:45.416384 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.416272 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7sfr\" (UniqueName: \"kubernetes.io/projected/dd6d22e7-d338-4175-8d03-1416762443a9-kube-api-access-p7sfr\") pod \"dd6d22e7-d338-4175-8d03-1416762443a9\" (UID: \"dd6d22e7-d338-4175-8d03-1416762443a9\") " Jul 06 23:50:45.416447 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.416419 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/814a5015-728b-4ff4-a63b-9f3358d15eba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jgp6f\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.416499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.416471 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpftd\" (UniqueName: \"kubernetes.io/projected/814a5015-728b-4ff4-a63b-9f3358d15eba-kube-api-access-wpftd\") pod \"kuadrant-operator-controller-manager-86878c769f-jgp6f\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.416536 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.416501 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6d22e7-d338-4175-8d03-1416762443a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dd6d22e7-d338-4175-8d03-1416762443a9" (UID: "dd6d22e7-d338-4175-8d03-1416762443a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:50:45.416627 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.416609 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd6d22e7-d338-4175-8d03-1416762443a9-extensions-socket-volume\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:50:45.418344 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.418322 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd6d22e7-d338-4175-8d03-1416762443a9-kube-api-access-p7sfr" (OuterVolumeSpecName: "kube-api-access-p7sfr") pod "dd6d22e7-d338-4175-8d03-1416762443a9" (UID: "dd6d22e7-d338-4175-8d03-1416762443a9"). InnerVolumeSpecName "kube-api-access-p7sfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:50:45.517750 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.517716 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/814a5015-728b-4ff4-a63b-9f3358d15eba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jgp6f\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.517750 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.517759 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpftd\" (UniqueName: \"kubernetes.io/projected/814a5015-728b-4ff4-a63b-9f3358d15eba-kube-api-access-wpftd\") pod \"kuadrant-operator-controller-manager-86878c769f-jgp6f\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.517908 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.517810 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7sfr\" (UniqueName: \"kubernetes.io/projected/dd6d22e7-d338-4175-8d03-1416762443a9-kube-api-access-p7sfr\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:50:45.518059 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.518039 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/814a5015-728b-4ff4-a63b-9f3358d15eba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jgp6f\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.527029 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.527005 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpftd\" (UniqueName: \"kubernetes.io/projected/814a5015-728b-4ff4-a63b-9f3358d15eba-kube-api-access-wpftd\") pod \"kuadrant-operator-controller-manager-86878c769f-jgp6f\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.604118 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.604060 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:45.743237 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:45.743212 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f"] Jul 06 23:50:45.743723 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:50:45.743700 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814a5015_728b_4ff4_a63b_9f3358d15eba.slice/crio-39066145aa29f669e6f3e07f12ed18444f134b071a3e532dfd406b63faf21814 WatchSource:0}: Error finding container 39066145aa29f669e6f3e07f12ed18444f134b071a3e532dfd406b63faf21814: Status 404 returned error can't find the container with id 39066145aa29f669e6f3e07f12ed18444f134b071a3e532dfd406b63faf21814 Jul 06 23:50:46.085009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.079943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" event={"ID":"814a5015-728b-4ff4-a63b-9f3358d15eba","Type":"ContainerStarted","Data":"9c502f4a5fb659297ad44b59434880a1a5ce50caaa9cadc45c8620555e75c473"} Jul 06 23:50:46.085009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.080055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" event={"ID":"814a5015-728b-4ff4-a63b-9f3358d15eba","Type":"ContainerStarted","Data":"39066145aa29f669e6f3e07f12ed18444f134b071a3e532dfd406b63faf21814"} Jul 06 23:50:46.085009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.080100 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:50:46.086596 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.086566 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd6d22e7-d338-4175-8d03-1416762443a9" containerID="5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4" exitCode=0 Jul 06 23:50:46.086729 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.086600 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" event={"ID":"dd6d22e7-d338-4175-8d03-1416762443a9","Type":"ContainerDied","Data":"5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4"} Jul 06 23:50:46.086729 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.086630 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" event={"ID":"dd6d22e7-d338-4175-8d03-1416762443a9","Type":"ContainerDied","Data":"f18336cace11bdfa7baaf5c2b682da1de6db1dc27970e9e23dea4b8c3900cf35"} Jul 06 23:50:46.086729 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.086626 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2" Jul 06 23:50:46.086729 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.086644 2556 scope.go:117] "RemoveContainer" containerID="5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4" Jul 06 23:50:46.095911 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.095894 2556 scope.go:117] "RemoveContainer" containerID="5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4" Jul 06 23:50:46.096149 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:50:46.096131 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4\": container with ID starting with 5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4 not found: ID does not exist" containerID="5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4" Jul 06 23:50:46.096238 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.096156 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4"} err="failed to get container status \"5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4\": rpc error: code = NotFound desc = could not find container \"5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4\": container with ID starting with 5e78aa84b37cd407df6101da0b87924577f78e46b0cf1f68bf36ed10e9d5e9d4 not found: ID does not exist" Jul 06 23:50:46.102759 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.102722 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" podStartSLOduration=1.102707564 podStartE2EDuration="1.102707564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:46.10141076 +0000 UTC m=+437.766585808" watchObservedRunningTime="2026-07-06 23:50:46.102707564 +0000 UTC m=+437.767882602" Jul 06 23:50:46.117455 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.117419 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2"] Jul 06 23:50:46.123749 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.123728 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2xl2"] Jul 06 23:50:46.863682 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:46.863655 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd6d22e7-d338-4175-8d03-1416762443a9" path="/var/lib/kubelet/pods/dd6d22e7-d338-4175-8d03-1416762443a9/volumes" Jul 06 23:50:53.085181 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.085097 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5754c5bd-5zv7s"] Jul 06 23:50:53.087676 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.087657 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.099787 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.099756 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5754c5bd-5zv7s"] Jul 06 23:50:53.180180 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.180155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-service-ca\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.180312 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.180185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fa51485-dc63-4252-be87-65594397dcfa-console-oauth-config\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.180312 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.180298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5psc\" (UniqueName: \"kubernetes.io/projected/0fa51485-dc63-4252-be87-65594397dcfa-kube-api-access-n5psc\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.180396 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.180333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fa51485-dc63-4252-be87-65594397dcfa-console-serving-cert\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.180396 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.180376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-trusted-ca-bundle\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.180476 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.180404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-console-config\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.180476 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.180437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-oauth-serving-cert\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.281721 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.281696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-trusted-ca-bundle\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.281827 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.281731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-console-config\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.281827 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.281756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-oauth-serving-cert\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.281827 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.281778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-service-ca\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.281827 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.281803 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fa51485-dc63-4252-be87-65594397dcfa-console-oauth-config\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.282024 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.281857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5psc\" (UniqueName: \"kubernetes.io/projected/0fa51485-dc63-4252-be87-65594397dcfa-kube-api-access-n5psc\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.282024 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.281892 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fa51485-dc63-4252-be87-65594397dcfa-console-serving-cert\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.282709 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.282681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-console-config\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.282803 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.282738 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-oauth-serving-cert\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.282803 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.282681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-service-ca\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.283077 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.283058 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa51485-dc63-4252-be87-65594397dcfa-trusted-ca-bundle\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.284666 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.284644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fa51485-dc63-4252-be87-65594397dcfa-console-oauth-config\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.284846 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.284825 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fa51485-dc63-4252-be87-65594397dcfa-console-serving-cert\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.290445 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.290423 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5psc\" (UniqueName: \"kubernetes.io/projected/0fa51485-dc63-4252-be87-65594397dcfa-kube-api-access-n5psc\") pod \"console-6b5754c5bd-5zv7s\" (UID: \"0fa51485-dc63-4252-be87-65594397dcfa\") " pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.397181 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.397158 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:50:53.529144 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:53.529117 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5754c5bd-5zv7s"] Jul 06 23:50:53.530800 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:50:53.530771 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa51485_dc63_4252_be87_65594397dcfa.slice/crio-fbbf787759f9440451f1f2d57a48d364ed43f96e10a5d908395da98acce602f6 WatchSource:0}: Error finding container fbbf787759f9440451f1f2d57a48d364ed43f96e10a5d908395da98acce602f6: Status 404 returned error can't find the container with id fbbf787759f9440451f1f2d57a48d364ed43f96e10a5d908395da98acce602f6 Jul 06 23:50:54.135613 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:54.135581 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5754c5bd-5zv7s" event={"ID":"0fa51485-dc63-4252-be87-65594397dcfa","Type":"ContainerStarted","Data":"5a4e3594c1f06ea9916bd134dc0d4535904e91990b355e56b79b69118ac18f35"} Jul 06 23:50:54.135995 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:54.135627 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5754c5bd-5zv7s" event={"ID":"0fa51485-dc63-4252-be87-65594397dcfa","Type":"ContainerStarted","Data":"fbbf787759f9440451f1f2d57a48d364ed43f96e10a5d908395da98acce602f6"} Jul 06 23:50:54.157337 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:54.157289 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b5754c5bd-5zv7s" podStartSLOduration=1.157274417 podStartE2EDuration="1.157274417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:54.154920832 +0000 UTC m=+445.820095884" watchObservedRunningTime="2026-07-06 23:50:54.157274417 +0000 UTC m=+445.822449455" Jul 06 23:50:57.095233 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:50:57.095183 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 06 23:51:03.397375 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:03.397341 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:51:03.397820 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:03.397405 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:51:03.401646 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:03.401626 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:51:04.190575 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:04.190548 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b5754c5bd-5zv7s" Jul 06 23:51:04.244162 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:04.244133 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-696fbccc7d-klwgq"] Jul 06 23:51:18.828716 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.828677 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:51:18.831805 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.831788 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:18.834346 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.834328 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 23:51:18.834450 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.834329 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c6m7v\"" Jul 06 23:51:18.840045 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.840026 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:51:18.866572 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.866545 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:51:18.872436 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.872411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hft\" (UniqueName: \"kubernetes.io/projected/59d67959-8eb8-4d1e-b83c-c4af26d644ee-kube-api-access-96hft\") pod \"limitador-limitador-54d6d988d5-999xb\" (UID: \"59d67959-8eb8-4d1e-b83c-c4af26d644ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:18.872593 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.872475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59d67959-8eb8-4d1e-b83c-c4af26d644ee-config-file\") pod \"limitador-limitador-54d6d988d5-999xb\" (UID: \"59d67959-8eb8-4d1e-b83c-c4af26d644ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:18.973567 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.973533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59d67959-8eb8-4d1e-b83c-c4af26d644ee-config-file\") pod \"limitador-limitador-54d6d988d5-999xb\" (UID: \"59d67959-8eb8-4d1e-b83c-c4af26d644ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:18.973759 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.973640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96hft\" (UniqueName: \"kubernetes.io/projected/59d67959-8eb8-4d1e-b83c-c4af26d644ee-kube-api-access-96hft\") pod \"limitador-limitador-54d6d988d5-999xb\" (UID: \"59d67959-8eb8-4d1e-b83c-c4af26d644ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:18.974171 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.974149 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59d67959-8eb8-4d1e-b83c-c4af26d644ee-config-file\") pod \"limitador-limitador-54d6d988d5-999xb\" (UID: \"59d67959-8eb8-4d1e-b83c-c4af26d644ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:18.981771 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:18.981747 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hft\" (UniqueName: \"kubernetes.io/projected/59d67959-8eb8-4d1e-b83c-c4af26d644ee-kube-api-access-96hft\") pod \"limitador-limitador-54d6d988d5-999xb\" (UID: \"59d67959-8eb8-4d1e-b83c-c4af26d644ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:19.143170 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:19.143071 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:19.286972 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:19.286941 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:51:19.294625 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:51:19.294593 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d67959_8eb8_4d1e_b83c_c4af26d644ee.slice/crio-b0644a07f1d839911d1d0589837e2795d093fc2b06c563462ece35eded7e4807 WatchSource:0}: Error finding container b0644a07f1d839911d1d0589837e2795d093fc2b06c563462ece35eded7e4807: Status 404 returned error can't find the container with id b0644a07f1d839911d1d0589837e2795d093fc2b06c563462ece35eded7e4807 Jul 06 23:51:20.279957 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:20.279912 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" event={"ID":"59d67959-8eb8-4d1e-b83c-c4af26d644ee","Type":"ContainerStarted","Data":"b0644a07f1d839911d1d0589837e2795d093fc2b06c563462ece35eded7e4807"} Jul 06 23:51:22.293646 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:22.293608 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" event={"ID":"59d67959-8eb8-4d1e-b83c-c4af26d644ee","Type":"ContainerStarted","Data":"a8b02356f5332d1fb716fc4db0fbc3a568b5ee53ca9c29895b545d7e0e2ae485"} Jul 06 23:51:22.294067 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:22.293671 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:51:22.313329 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:22.313283 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" podStartSLOduration=1.8782134240000001 podStartE2EDuration="4.313267898s" totalImagesPullingTime="2.435054474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:22.310569016 +0000 UTC m=+473.975744068" watchObservedRunningTime="2026-07-06 23:51:22.313267898 +0000 UTC m=+473.978442936" Jul 06 23:51:29.270900 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.270861 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-696fbccc7d-klwgq" podUID="f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" containerName="console" containerID="cri-o://ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153" gracePeriod=15 Jul 06 23:51:29.535045 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.534994 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:51:29.563875 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.563851 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-config\") pod \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " Jul 06 23:51:29.564009 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.563908 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-serving-cert\") pod \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " Jul 06 23:51:29.564111 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564091 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47mmm\" (UniqueName: \"kubernetes.io/projected/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-kube-api-access-47mmm\") pod \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " Jul 06 23:51:29.564175 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564160 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-trusted-ca-bundle\") pod \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " Jul 06 23:51:29.564259 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564227 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-oauth-serving-cert\") pod \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " Jul 06 23:51:29.564311 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564280 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-oauth-config\") pod \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " Jul 06 23:51:29.564311 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564297 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-config" (OuterVolumeSpecName: "console-config") pod "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" (UID: "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:29.564411 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564328 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-service-ca\") pod \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\" (UID: \"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39\") " Jul 06 23:51:29.564615 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564595 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:51:29.564935 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564610 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" (UID: "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:29.565047 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564639 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" (UID: "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:29.565047 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.564727 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" (UID: "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:51:29.566364 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.566334 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" (UID: "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:29.566443 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.566390 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" (UID: "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:51:29.566443 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.566414 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-kube-api-access-47mmm" (OuterVolumeSpecName: "kube-api-access-47mmm") pod "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" (UID: "f6d1c6e2-9b01-4a8c-9116-18dbcb530c39"). InnerVolumeSpecName "kube-api-access-47mmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:51:29.665643 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.665605 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-trusted-ca-bundle\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:51:29.665643 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.665635 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-oauth-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:51:29.665643 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.665647 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-oauth-config\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:51:29.665875 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.665661 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-service-ca\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:51:29.665875 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.665673 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-console-serving-cert\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:51:29.665875 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:29.665686 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47mmm\" (UniqueName: \"kubernetes.io/projected/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39-kube-api-access-47mmm\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 06 23:51:30.338483 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.338440 2556 generic.go:356] "Generic (PLEG): container finished" podID="f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" containerID="ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153" exitCode=0 Jul 06 23:51:30.338858 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.338492 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696fbccc7d-klwgq" event={"ID":"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39","Type":"ContainerDied","Data":"ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153"} Jul 06 23:51:30.338858 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.338556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696fbccc7d-klwgq" event={"ID":"f6d1c6e2-9b01-4a8c-9116-18dbcb530c39","Type":"ContainerDied","Data":"b86d6b258f963958cefe7144b0b7ff7b38f746c10e505f001646fb45c44e3b22"} Jul 06 23:51:30.338858 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.338494 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696fbccc7d-klwgq" Jul 06 23:51:30.338858 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.338581 2556 scope.go:117] "RemoveContainer" containerID="ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153" Jul 06 23:51:30.347859 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.347838 2556 scope.go:117] "RemoveContainer" containerID="ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153" Jul 06 23:51:30.348098 ip-10-0-135-156 kubenswrapper[2556]: E0706 23:51:30.348079 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153\": container with ID starting with ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153 not found: ID does not exist" containerID="ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153" Jul 06 23:51:30.348147 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.348107 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153"} err="failed to get container status \"ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153\": rpc error: code = NotFound desc = could not find container \"ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153\": container with ID starting with ae370fcae46572646a3329e30a4c8622b6c659de4128320561eb9b24da4bb153 not found: ID does not exist" Jul 06 23:51:30.359499 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.359476 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-696fbccc7d-klwgq"] Jul 06 23:51:30.363124 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.363106 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-696fbccc7d-klwgq"] Jul 06 23:51:30.863656 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:30.863622 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" path="/var/lib/kubelet/pods/f6d1c6e2-9b01-4a8c-9116-18dbcb530c39/volumes" Jul 06 23:51:33.300169 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:51:33.300136 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-999xb" Jul 06 23:52:36.412882 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:52:36.412847 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:52:55.900459 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:52:55.900425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:53:04.935373 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:04.935337 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:53:15.639211 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.639161 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6"] Jul 06 23:53:15.639695 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.639537 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" containerName="console" Jul 06 23:53:15.639695 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.639549 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" containerName="console" Jul 06 23:53:15.639695 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.639627 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d1c6e2-9b01-4a8c-9116-18dbcb530c39" containerName="console" Jul 06 23:53:15.642933 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.642913 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.645793 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.645774 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2qb9\"" Jul 06 23:53:15.645885 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.645799 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 23:53:15.646588 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.646575 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 23:53:15.646694 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.646678 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 23:53:15.657398 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.657381 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6"] Jul 06 23:53:15.755529 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.755495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.755705 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.755544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.755705 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.755566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.755705 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.755633 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a4520b3-4f37-4d8d-a207-e91ad3042f55-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.755705 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.755686 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbm24\" (UniqueName: \"kubernetes.io/projected/5a4520b3-4f37-4d8d-a207-e91ad3042f55-kube-api-access-kbm24\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.755841 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.755731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.856793 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.856755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a4520b3-4f37-4d8d-a207-e91ad3042f55-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.856991 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.856813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbm24\" (UniqueName: \"kubernetes.io/projected/5a4520b3-4f37-4d8d-a207-e91ad3042f55-kube-api-access-kbm24\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.856991 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.856852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.856991 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.856880 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.856991 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.856922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.856991 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.856948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.857392 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.857364 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.857392 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.857390 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.857533 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.857471 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.859294 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.859278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a4520b3-4f37-4d8d-a207-e91ad3042f55-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.859570 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.859550 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a4520b3-4f37-4d8d-a207-e91ad3042f55-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.871072 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.871050 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbm24\" (UniqueName: \"kubernetes.io/projected/5a4520b3-4f37-4d8d-a207-e91ad3042f55-kube-api-access-kbm24\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8mkh6\" (UID: \"5a4520b3-4f37-4d8d-a207-e91ad3042f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:15.953789 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:15.953752 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:16.096673 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:16.096649 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6"] Jul 06 23:53:16.098379 ip-10-0-135-156 kubenswrapper[2556]: W0706 23:53:16.098351 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4520b3_4f37_4d8d_a207_e91ad3042f55.slice/crio-f823c7e950f47afeced57d8acbe3c9c753d87fe1307ee3819f0d2b63f6252ecc WatchSource:0}: Error finding container f823c7e950f47afeced57d8acbe3c9c753d87fe1307ee3819f0d2b63f6252ecc: Status 404 returned error can't find the container with id f823c7e950f47afeced57d8acbe3c9c753d87fe1307ee3819f0d2b63f6252ecc Jul 06 23:53:16.897420 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:16.897381 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" event={"ID":"5a4520b3-4f37-4d8d-a207-e91ad3042f55","Type":"ContainerStarted","Data":"f823c7e950f47afeced57d8acbe3c9c753d87fe1307ee3819f0d2b63f6252ecc"} Jul 06 23:53:17.178873 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:17.178841 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:53:17.904619 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:17.904584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" event={"ID":"5a4520b3-4f37-4d8d-a207-e91ad3042f55","Type":"ContainerStarted","Data":"27898d639900fcf9df07c4f43848ff26be748ba826c508224beb8c34ccee7606"} Jul 06 23:53:17.928464 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:17.928414 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" podStartSLOduration=1.912572489 podStartE2EDuration="2.92839705s" totalImagesPullingTime="1.015824561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:17.926577298 +0000 UTC m=+589.591752331" watchObservedRunningTime="2026-07-06 23:53:17.92839705 +0000 UTC m=+589.593572087" Jul 06 23:53:25.954798 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:25.954766 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:25.955230 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:25.954821 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:25.967383 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:25.967359 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:26.960011 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:26.959984 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8mkh6" Jul 06 23:53:37.019945 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:37.019907 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:53:50.129436 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:50.129355 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:53:59.739624 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:53:59.739590 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:55:15.130095 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:55:15.130060 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:55:25.820888 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:55:25.820809 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:55:36.321670 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:55:36.321636 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:55:44.727126 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:55:44.727081 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:55:55.731661 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:55:55.731629 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:56:23.318639 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:56:23.318602 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:56:34.841541 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:56:34.841500 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:57:09.334420 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:57:09.334342 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:57:17.730412 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:57:17.730382 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:57:28.227388 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:57:28.227358 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:57:36.023140 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:57:36.023107 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:57:46.729170 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:57:46.729133 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:57:55.628497 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:57:55.628459 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:58:07.630703 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:58:07.630664 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:58:14.727373 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:58:14.727338 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:58:22.125014 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:58:22.124924 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:58:31.423924 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:58:31.423886 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:58:43.624598 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:58:43.624566 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:58:52.332413 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:58:52.332378 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:59:16.729485 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:59:16.729450 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:59:29.341249 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:59:29.341188 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:59:44.541643 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:59:44.541596 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 06 23:59:54.520935 ip-10-0-135-156 kubenswrapper[2556]: I0706 23:59:54.520833 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:00:03.828803 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:03.828759 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:00:13.123952 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:13.123904 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:00:21.114414 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:21.114374 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:00:47.975483 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:47.975432 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f"] Jul 07 00:00:47.976067 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:47.975724 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" podUID="814a5015-728b-4ff4-a63b-9f3358d15eba" containerName="manager" containerID="cri-o://9c502f4a5fb659297ad44b59434880a1a5ce50caaa9cadc45c8620555e75c473" gracePeriod=10 Jul 07 00:00:50.330675 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.330641 2556 generic.go:356] "Generic (PLEG): container finished" podID="814a5015-728b-4ff4-a63b-9f3358d15eba" containerID="9c502f4a5fb659297ad44b59434880a1a5ce50caaa9cadc45c8620555e75c473" exitCode=0 Jul 07 00:00:50.331067 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.330709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" event={"ID":"814a5015-728b-4ff4-a63b-9f3358d15eba","Type":"ContainerDied","Data":"9c502f4a5fb659297ad44b59434880a1a5ce50caaa9cadc45c8620555e75c473"} Jul 07 00:00:50.453710 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.453669 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 07 00:00:50.545924 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.545826 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/814a5015-728b-4ff4-a63b-9f3358d15eba-extensions-socket-volume\") pod \"814a5015-728b-4ff4-a63b-9f3358d15eba\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " Jul 07 00:00:50.545924 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.545924 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpftd\" (UniqueName: \"kubernetes.io/projected/814a5015-728b-4ff4-a63b-9f3358d15eba-kube-api-access-wpftd\") pod \"814a5015-728b-4ff4-a63b-9f3358d15eba\" (UID: \"814a5015-728b-4ff4-a63b-9f3358d15eba\") " Jul 07 00:00:50.546255 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.546231 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814a5015-728b-4ff4-a63b-9f3358d15eba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "814a5015-728b-4ff4-a63b-9f3358d15eba" (UID: "814a5015-728b-4ff4-a63b-9f3358d15eba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:00:50.548291 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.548269 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/814a5015-728b-4ff4-a63b-9f3358d15eba-kube-api-access-wpftd" (OuterVolumeSpecName: "kube-api-access-wpftd") pod "814a5015-728b-4ff4-a63b-9f3358d15eba" (UID: "814a5015-728b-4ff4-a63b-9f3358d15eba"). InnerVolumeSpecName "kube-api-access-wpftd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:50.646943 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.646905 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpftd\" (UniqueName: \"kubernetes.io/projected/814a5015-728b-4ff4-a63b-9f3358d15eba-kube-api-access-wpftd\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:00:50.646943 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:50.646938 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/814a5015-728b-4ff4-a63b-9f3358d15eba-extensions-socket-volume\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:00:51.337930 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:51.337896 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" Jul 07 00:00:51.338379 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:51.337895 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f" event={"ID":"814a5015-728b-4ff4-a63b-9f3358d15eba","Type":"ContainerDied","Data":"39066145aa29f669e6f3e07f12ed18444f134b071a3e532dfd406b63faf21814"} Jul 07 00:00:51.338379 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:51.338028 2556 scope.go:117] "RemoveContainer" containerID="9c502f4a5fb659297ad44b59434880a1a5ce50caaa9cadc45c8620555e75c473" Jul 07 00:00:51.357232 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:51.357184 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f"] Jul 07 00:00:51.360814 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:51.360787 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgp6f"] Jul 07 00:00:52.865053 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:00:52.865015 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="814a5015-728b-4ff4-a63b-9f3358d15eba" path="/var/lib/kubelet/pods/814a5015-728b-4ff4-a63b-9f3358d15eba/volumes" Jul 07 00:01:49.154552 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.154516 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7"] Jul 07 00:01:49.154998 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.154902 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814a5015-728b-4ff4-a63b-9f3358d15eba" containerName="manager" Jul 07 00:01:49.154998 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.154913 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="814a5015-728b-4ff4-a63b-9f3358d15eba" containerName="manager" Jul 07 00:01:49.154998 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.154991 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="814a5015-728b-4ff4-a63b-9f3358d15eba" containerName="manager" Jul 07 00:01:49.159169 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.159148 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.164987 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.164969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z9kl7\"" Jul 07 00:01:49.177706 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.177676 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7"] Jul 07 00:01:49.262392 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.262355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9aa061f-2f51-48ac-bee4-636e4806e93a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-527f7\" (UID: \"b9aa061f-2f51-48ac-bee4-636e4806e93a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.262574 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.262419 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdr8\" (UniqueName: \"kubernetes.io/projected/b9aa061f-2f51-48ac-bee4-636e4806e93a-kube-api-access-jrdr8\") pod \"kuadrant-operator-controller-manager-86878c769f-527f7\" (UID: \"b9aa061f-2f51-48ac-bee4-636e4806e93a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.363515 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.363480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdr8\" (UniqueName: \"kubernetes.io/projected/b9aa061f-2f51-48ac-bee4-636e4806e93a-kube-api-access-jrdr8\") pod \"kuadrant-operator-controller-manager-86878c769f-527f7\" (UID: \"b9aa061f-2f51-48ac-bee4-636e4806e93a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.363678 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.363577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9aa061f-2f51-48ac-bee4-636e4806e93a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-527f7\" (UID: \"b9aa061f-2f51-48ac-bee4-636e4806e93a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.363920 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.363903 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9aa061f-2f51-48ac-bee4-636e4806e93a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-527f7\" (UID: \"b9aa061f-2f51-48ac-bee4-636e4806e93a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.385062 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.385024 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdr8\" (UniqueName: \"kubernetes.io/projected/b9aa061f-2f51-48ac-bee4-636e4806e93a-kube-api-access-jrdr8\") pod \"kuadrant-operator-controller-manager-86878c769f-527f7\" (UID: \"b9aa061f-2f51-48ac-bee4-636e4806e93a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.469537 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.469442 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:49.615057 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.615032 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7"] Jul 07 00:01:49.617475 ip-10-0-135-156 kubenswrapper[2556]: W0707 00:01:49.617447 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9aa061f_2f51_48ac_bee4_636e4806e93a.slice/crio-bc006bda6d04d87ff25e72fcffa451eb7456c515d28255c6279042230a07effb WatchSource:0}: Error finding container bc006bda6d04d87ff25e72fcffa451eb7456c515d28255c6279042230a07effb: Status 404 returned error can't find the container with id bc006bda6d04d87ff25e72fcffa451eb7456c515d28255c6279042230a07effb Jul 07 00:01:49.648734 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:49.648694 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" event={"ID":"b9aa061f-2f51-48ac-bee4-636e4806e93a","Type":"ContainerStarted","Data":"bc006bda6d04d87ff25e72fcffa451eb7456c515d28255c6279042230a07effb"} Jul 07 00:01:50.656023 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:50.655979 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" event={"ID":"b9aa061f-2f51-48ac-bee4-636e4806e93a","Type":"ContainerStarted","Data":"0d2a329976ee47f733be96888c4f676e8c331cb437c2565158668078c42f80a0"} Jul 07 00:01:50.656455 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:50.656098 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:01:50.678065 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:01:50.678004 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" podStartSLOduration=1.677986888 podStartE2EDuration="1.677986888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:50.676366504 +0000 UTC m=+1102.341541553" watchObservedRunningTime="2026-07-07 00:01:50.677986888 +0000 UTC m=+1102.343161925" Jul 07 00:02:01.663129 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:02:01.663093 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-527f7" Jul 07 00:02:10.022498 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:02:10.022458 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:02:20.324610 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:02:20.324571 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:02:31.219668 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:02:31.219640 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:02:41.525794 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:02:41.525759 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:02:52.333400 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:02:52.333326 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:03:03.123015 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:03:03.122978 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:03:13.122917 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:03:13.122883 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:03:23.327059 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:03:23.327030 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:03:34.324318 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:03:34.324288 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:03:43.820988 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:03:43.820958 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:03:53.729058 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:03:53.729024 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:04:16.236754 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:04:16.236713 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:04:25.242349 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:04:25.242258 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:04:34.902278 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:04:34.902248 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:04:45.922725 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:04:45.922691 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:05:01.820378 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:05:01.820346 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:05:10.622545 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:05:10.622507 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:05:19.625716 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:05:19.625681 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:05:28.924946 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:05:28.924910 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:05:37.525938 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:05:37.525891 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:05:46.326973 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:05:46.326935 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:05:51.927369 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:05:51.927284 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:06:00.634375 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:06:00.634335 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:06:10.040690 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:06:10.040658 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:06:21.158281 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:06:21.158245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:06:30.130659 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:06:30.130624 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:06:43.822297 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:06:43.822263 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:06:52.128968 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:06:52.128932 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:07:03.134363 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:07:03.134321 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:07:13.232443 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:07:13.232398 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:07:25.921810 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:07:25.921731 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:07:34.128347 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:07:34.128316 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:07:43.443366 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:07:43.443330 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:07:52.028108 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:07:52.028068 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:08:01.120871 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:08:01.120835 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:08:19.119066 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:08:19.119032 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:08:29.529239 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:08:29.529186 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:08:38.531413 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:08:38.531377 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:08:47.239641 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:08:47.239606 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:10:09.425708 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:10:09.425678 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:10:17.922485 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:10:17.922450 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:10:29.227584 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:10:29.227548 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:10:40.326973 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:10:40.326936 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:11:13.715749 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:11:13.715716 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:11:45.323823 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:11:45.323785 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:12:02.124306 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:12:02.124226 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:12:11.330881 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:12:11.330841 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:12:21.127351 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:12:21.127317 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:12:55.522004 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:12:55.521968 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:13:16.829831 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:13:16.829795 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:13:27.821548 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:13:27.821505 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:14:18.427867 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:14:18.427831 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:14:28.727265 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:14:28.727232 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:14:39.136404 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:14:39.136369 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:14:54.027429 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:14:54.027338 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:15:00.133870 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.133836 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr"] Jul 07 00:15:00.137295 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.137274 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" Jul 07 00:15:00.140827 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.140806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-26pnj\"" Jul 07 00:15:00.145749 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.145720 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-dtb6m"] Jul 07 00:15:00.149627 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.149607 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx"] Jul 07 00:15:00.149743 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.149725 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" Jul 07 00:15:00.153374 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.153356 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr"] Jul 07 00:15:00.153472 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.153432 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" Jul 07 00:15:00.163268 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.163245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-dtb6m"] Jul 07 00:15:00.178173 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.178147 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx"] Jul 07 00:15:00.248565 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.248531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxlnt\" (UniqueName: \"kubernetes.io/projected/dd27cb2b-edf6-4afe-a764-4b31d96c4730-kube-api-access-wxlnt\") pod \"maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx\" (UID: \"dd27cb2b-edf6-4afe-a764-4b31d96c4730\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" Jul 07 00:15:00.248698 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.248574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54fbc\" (UniqueName: \"kubernetes.io/projected/040d7a6c-94f6-41b0-9b21-384370474734-kube-api-access-54fbc\") pod \"maas-api-key-cleanup-29723055-dtb6m\" (UID: \"040d7a6c-94f6-41b0-9b21-384370474734\") " pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" Jul 07 00:15:00.248754 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.248691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlxwk\" (UniqueName: \"kubernetes.io/projected/001baa91-468b-46da-92b6-8913c86f38dd-kube-api-access-hlxwk\") pod \"maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr\" (UID: \"001baa91-468b-46da-92b6-8913c86f38dd\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" Jul 07 00:15:00.349842 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.349806 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlxwk\" (UniqueName: \"kubernetes.io/projected/001baa91-468b-46da-92b6-8913c86f38dd-kube-api-access-hlxwk\") pod \"maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr\" (UID: \"001baa91-468b-46da-92b6-8913c86f38dd\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" Jul 07 00:15:00.349981 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.349903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxlnt\" (UniqueName: \"kubernetes.io/projected/dd27cb2b-edf6-4afe-a764-4b31d96c4730-kube-api-access-wxlnt\") pod \"maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx\" (UID: \"dd27cb2b-edf6-4afe-a764-4b31d96c4730\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" Jul 07 00:15:00.349981 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.349944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54fbc\" (UniqueName: \"kubernetes.io/projected/040d7a6c-94f6-41b0-9b21-384370474734-kube-api-access-54fbc\") pod \"maas-api-key-cleanup-29723055-dtb6m\" (UID: \"040d7a6c-94f6-41b0-9b21-384370474734\") " pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" Jul 07 00:15:00.358359 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.358333 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxlnt\" (UniqueName: \"kubernetes.io/projected/dd27cb2b-edf6-4afe-a764-4b31d96c4730-kube-api-access-wxlnt\") pod \"maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx\" (UID: \"dd27cb2b-edf6-4afe-a764-4b31d96c4730\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" Jul 07 00:15:00.358456 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.358333 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54fbc\" (UniqueName: \"kubernetes.io/projected/040d7a6c-94f6-41b0-9b21-384370474734-kube-api-access-54fbc\") pod \"maas-api-key-cleanup-29723055-dtb6m\" (UID: \"040d7a6c-94f6-41b0-9b21-384370474734\") " pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" Jul 07 00:15:00.358456 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.358333 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlxwk\" (UniqueName: \"kubernetes.io/projected/001baa91-468b-46da-92b6-8913c86f38dd-kube-api-access-hlxwk\") pod \"maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr\" (UID: \"001baa91-468b-46da-92b6-8913c86f38dd\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" Jul 07 00:15:00.450188 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.450166 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" Jul 07 00:15:00.461344 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.461217 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" Jul 07 00:15:00.470323 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.470305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" Jul 07 00:15:00.612897 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.612848 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr"] Jul 07 00:15:00.615257 ip-10-0-135-156 kubenswrapper[2556]: W0707 00:15:00.615230 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001baa91_468b_46da_92b6_8913c86f38dd.slice/crio-18a6b38f4731b5fe6c0176e6b693c72a59fddb2469bc088f72544cd23d73ca30 WatchSource:0}: Error finding container 18a6b38f4731b5fe6c0176e6b693c72a59fddb2469bc088f72544cd23d73ca30: Status 404 returned error can't find the container with id 18a6b38f4731b5fe6c0176e6b693c72a59fddb2469bc088f72544cd23d73ca30 Jul 07 00:15:00.617695 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.617675 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:15:00.845428 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.845180 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-dtb6m"] Jul 07 00:15:00.847093 ip-10-0-135-156 kubenswrapper[2556]: W0707 00:15:00.847058 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040d7a6c_94f6_41b0_9b21_384370474734.slice/crio-260d8fc582293540c7e9125a37127dc87ccc4c68f22e39991e8c39d9dd2d4975 WatchSource:0}: Error finding container 260d8fc582293540c7e9125a37127dc87ccc4c68f22e39991e8c39d9dd2d4975: Status 404 returned error can't find the container with id 260d8fc582293540c7e9125a37127dc87ccc4c68f22e39991e8c39d9dd2d4975 Jul 07 00:15:00.848126 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.848104 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx"] Jul 07 00:15:00.849410 ip-10-0-135-156 kubenswrapper[2556]: W0707 00:15:00.849388 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd27cb2b_edf6_4afe_a764_4b31d96c4730.slice/crio-5ac783a6e1861b26fbceb5382b3852dd5f718000a9a3d994f1a9deccc6b9368e WatchSource:0}: Error finding container 5ac783a6e1861b26fbceb5382b3852dd5f718000a9a3d994f1a9deccc6b9368e: Status 404 returned error can't find the container with id 5ac783a6e1861b26fbceb5382b3852dd5f718000a9a3d994f1a9deccc6b9368e Jul 07 00:15:00.892159 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.892122 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" event={"ID":"dd27cb2b-edf6-4afe-a764-4b31d96c4730","Type":"ContainerStarted","Data":"5ac783a6e1861b26fbceb5382b3852dd5f718000a9a3d994f1a9deccc6b9368e"} Jul 07 00:15:00.893426 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.893403 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" event={"ID":"001baa91-468b-46da-92b6-8913c86f38dd","Type":"ContainerStarted","Data":"18a6b38f4731b5fe6c0176e6b693c72a59fddb2469bc088f72544cd23d73ca30"} Jul 07 00:15:00.894563 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:00.894544 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" event={"ID":"040d7a6c-94f6-41b0-9b21-384370474734","Type":"ContainerStarted","Data":"260d8fc582293540c7e9125a37127dc87ccc4c68f22e39991e8c39d9dd2d4975"} Jul 07 00:15:03.917032 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:03.916992 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" event={"ID":"dd27cb2b-edf6-4afe-a764-4b31d96c4730","Type":"ContainerStarted","Data":"7feae4604e05f9acd0573a06175105320f8a52c623e43434f7ba79806658a016"} Jul 07 00:15:03.918528 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:03.918502 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" event={"ID":"001baa91-468b-46da-92b6-8913c86f38dd","Type":"ContainerStarted","Data":"6ff12926e9ec987d5aa6f7f343cc16e27d2e68b5721346e2917a4af12fd1b6b4"} Jul 07 00:15:03.919881 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:03.919858 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" event={"ID":"040d7a6c-94f6-41b0-9b21-384370474734","Type":"ContainerStarted","Data":"cdb84f2c7a3c7d98048095ad73e6ab74086b5a802b6ee32a7d1eea49cf347f2b"} Jul 07 00:15:03.934161 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:03.934115 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" podStartSLOduration=1.797321927 podStartE2EDuration="3.934098829s" totalImagesPullingTime="2.136776902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:03.932986366 +0000 UTC m=+1895.598161430" watchObservedRunningTime="2026-07-07 00:15:03.934098829 +0000 UTC m=+1895.599273867" Jul 07 00:15:03.948348 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:03.948180 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" podStartSLOduration=1.814969852 podStartE2EDuration="3.948163242s" totalImagesPullingTime="2.13319339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:03.947507914 +0000 UTC m=+1895.612682952" watchObservedRunningTime="2026-07-07 00:15:03.948163242 +0000 UTC m=+1895.613338281" Jul 07 00:15:03.964736 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:03.964686 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" podStartSLOduration=1.600152311 podStartE2EDuration="3.964669068s" totalImagesPullingTime="2.364516757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:03.96269108 +0000 UTC m=+1895.627866118" watchObservedRunningTime="2026-07-07 00:15:03.964669068 +0000 UTC m=+1895.629844107" Jul 07 00:15:04.926275 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:04.926237 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd27cb2b-edf6-4afe-a764-4b31d96c4730" containerID="7feae4604e05f9acd0573a06175105320f8a52c623e43434f7ba79806658a016" exitCode=0 Jul 07 00:15:04.926712 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:04.926318 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" event={"ID":"dd27cb2b-edf6-4afe-a764-4b31d96c4730","Type":"ContainerDied","Data":"7feae4604e05f9acd0573a06175105320f8a52c623e43434f7ba79806658a016"} Jul 07 00:15:04.927755 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:04.927732 2556 generic.go:356] "Generic (PLEG): container finished" podID="001baa91-468b-46da-92b6-8913c86f38dd" containerID="6ff12926e9ec987d5aa6f7f343cc16e27d2e68b5721346e2917a4af12fd1b6b4" exitCode=0 Jul 07 00:15:04.927859 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:04.927777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" event={"ID":"001baa91-468b-46da-92b6-8913c86f38dd","Type":"ContainerDied","Data":"6ff12926e9ec987d5aa6f7f343cc16e27d2e68b5721346e2917a4af12fd1b6b4"} Jul 07 00:15:04.929111 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:04.929091 2556 generic.go:356] "Generic (PLEG): container finished" podID="040d7a6c-94f6-41b0-9b21-384370474734" containerID="cdb84f2c7a3c7d98048095ad73e6ab74086b5a802b6ee32a7d1eea49cf347f2b" exitCode=0 Jul 07 00:15:04.929218 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:04.929141 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" event={"ID":"040d7a6c-94f6-41b0-9b21-384370474734","Type":"ContainerDied","Data":"cdb84f2c7a3c7d98048095ad73e6ab74086b5a802b6ee32a7d1eea49cf347f2b"} Jul 07 00:15:06.091878 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.091849 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" Jul 07 00:15:06.129786 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.129766 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" Jul 07 00:15:06.132781 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.132761 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" Jul 07 00:15:06.209733 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.209642 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxlnt\" (UniqueName: \"kubernetes.io/projected/dd27cb2b-edf6-4afe-a764-4b31d96c4730-kube-api-access-wxlnt\") pod \"dd27cb2b-edf6-4afe-a764-4b31d96c4730\" (UID: \"dd27cb2b-edf6-4afe-a764-4b31d96c4730\") " Jul 07 00:15:06.209733 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.209693 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54fbc\" (UniqueName: \"kubernetes.io/projected/040d7a6c-94f6-41b0-9b21-384370474734-kube-api-access-54fbc\") pod \"040d7a6c-94f6-41b0-9b21-384370474734\" (UID: \"040d7a6c-94f6-41b0-9b21-384370474734\") " Jul 07 00:15:06.209952 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.209748 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlxwk\" (UniqueName: \"kubernetes.io/projected/001baa91-468b-46da-92b6-8913c86f38dd-kube-api-access-hlxwk\") pod \"001baa91-468b-46da-92b6-8913c86f38dd\" (UID: \"001baa91-468b-46da-92b6-8913c86f38dd\") " Jul 07 00:15:06.211998 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.211965 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040d7a6c-94f6-41b0-9b21-384370474734-kube-api-access-54fbc" (OuterVolumeSpecName: "kube-api-access-54fbc") pod "040d7a6c-94f6-41b0-9b21-384370474734" (UID: "040d7a6c-94f6-41b0-9b21-384370474734"). InnerVolumeSpecName "kube-api-access-54fbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:06.212103 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.212004 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001baa91-468b-46da-92b6-8913c86f38dd-kube-api-access-hlxwk" (OuterVolumeSpecName: "kube-api-access-hlxwk") pod "001baa91-468b-46da-92b6-8913c86f38dd" (UID: "001baa91-468b-46da-92b6-8913c86f38dd"). InnerVolumeSpecName "kube-api-access-hlxwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:06.212103 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.212018 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd27cb2b-edf6-4afe-a764-4b31d96c4730-kube-api-access-wxlnt" (OuterVolumeSpecName: "kube-api-access-wxlnt") pod "dd27cb2b-edf6-4afe-a764-4b31d96c4730" (UID: "dd27cb2b-edf6-4afe-a764-4b31d96c4730"). InnerVolumeSpecName "kube-api-access-wxlnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:06.311161 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.311118 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxlnt\" (UniqueName: \"kubernetes.io/projected/dd27cb2b-edf6-4afe-a764-4b31d96c4730-kube-api-access-wxlnt\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:15:06.311161 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.311156 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54fbc\" (UniqueName: \"kubernetes.io/projected/040d7a6c-94f6-41b0-9b21-384370474734-kube-api-access-54fbc\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:15:06.311161 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.311166 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlxwk\" (UniqueName: \"kubernetes.io/projected/001baa91-468b-46da-92b6-8913c86f38dd-kube-api-access-hlxwk\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:15:06.949178 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.949147 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" Jul 07 00:15:06.949337 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.949151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx" event={"ID":"dd27cb2b-edf6-4afe-a764-4b31d96c4730","Type":"ContainerDied","Data":"5ac783a6e1861b26fbceb5382b3852dd5f718000a9a3d994f1a9deccc6b9368e"} Jul 07 00:15:06.949337 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.949301 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ac783a6e1861b26fbceb5382b3852dd5f718000a9a3d994f1a9deccc6b9368e" Jul 07 00:15:06.950680 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.950661 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" Jul 07 00:15:06.950803 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.950704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr" event={"ID":"001baa91-468b-46da-92b6-8913c86f38dd","Type":"ContainerDied","Data":"18a6b38f4731b5fe6c0176e6b693c72a59fddb2469bc088f72544cd23d73ca30"} Jul 07 00:15:06.950803 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.950741 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18a6b38f4731b5fe6c0176e6b693c72a59fddb2469bc088f72544cd23d73ca30" Jul 07 00:15:06.952350 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.952320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" event={"ID":"040d7a6c-94f6-41b0-9b21-384370474734","Type":"ContainerDied","Data":"260d8fc582293540c7e9125a37127dc87ccc4c68f22e39991e8c39d9dd2d4975"} Jul 07 00:15:06.952467 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.952352 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-dtb6m" Jul 07 00:15:06.952467 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:06.952364 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="260d8fc582293540c7e9125a37127dc87ccc4c68f22e39991e8c39d9dd2d4975" Jul 07 00:15:08.564950 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:08.564888 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr"] Jul 07 00:15:08.567993 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:08.567963 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-0a7418-29723055-f8wkr"] Jul 07 00:15:08.863758 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:08.863684 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="001baa91-468b-46da-92b6-8913c86f38dd" path="/var/lib/kubelet/pods/001baa91-468b-46da-92b6-8913c86f38dd/volumes" Jul 07 00:15:11.322272 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:11.322238 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:15:51.472625 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:51.472587 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx"] Jul 07 00:15:51.476824 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:51.476800 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-9caaee-29723055-8pzpx"] Jul 07 00:15:52.863495 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:52.863459 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd27cb2b-edf6-4afe-a764-4b31d96c4730" path="/var/lib/kubelet/pods/dd27cb2b-edf6-4afe-a764-4b31d96c4730/volumes" Jul 07 00:15:54.024438 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:15:54.024409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:16:06.927554 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:16:06.927510 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:16:18.929128 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:16:18.929091 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:16:28.527804 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:16:28.527775 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:16:39.423731 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:16:39.423698 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:16:50.623681 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:16:50.623648 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:17:02.923868 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:02.923833 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:17:25.530331 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.530290 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t"] Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.530827 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040d7a6c-94f6-41b0-9b21-384370474734" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.530847 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="040d7a6c-94f6-41b0-9b21-384370474734" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.530867 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd27cb2b-edf6-4afe-a764-4b31d96c4730" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.530875 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd27cb2b-edf6-4afe-a764-4b31d96c4730" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.530892 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001baa91-468b-46da-92b6-8913c86f38dd" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.530900 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="001baa91-468b-46da-92b6-8913c86f38dd" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.531005 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="001baa91-468b-46da-92b6-8913c86f38dd" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.531022 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd27cb2b-edf6-4afe-a764-4b31d96c4730" containerName="cleanup" Jul 07 00:17:25.531240 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.531032 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="040d7a6c-94f6-41b0-9b21-384370474734" containerName="cleanup" Jul 07 00:17:25.534393 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.534373 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.536871 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.536849 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"openshift-service-ca.crt\"" Jul 07 00:17:25.536960 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.536889 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"kube-root-ca.crt\"" Jul 07 00:17:25.538571 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.538543 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"default-dockercfg-c7s82\"" Jul 07 00:17:25.538820 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.538795 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"auth-test-model-1ea658-kserve-self-signed-certs\"" Jul 07 00:17:25.545600 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.545382 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t"] Jul 07 00:17:25.563493 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.563463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr684\" (UniqueName: \"kubernetes.io/projected/60190a22-3d23-49ed-a39b-e1fba539d30f-kube-api-access-nr684\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.563618 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.563513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-dshm\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.563618 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.563542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60190a22-3d23-49ed-a39b-e1fba539d30f-tls-certs\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.563618 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.563582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-model-cache\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.563755 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.563644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-tmp-dir\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.563755 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.563669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-home\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.664893 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.664861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-model-cache\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.665090 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.664908 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-tmp-dir\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.665090 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.664931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-home\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.665090 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.664990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr684\" (UniqueName: \"kubernetes.io/projected/60190a22-3d23-49ed-a39b-e1fba539d30f-kube-api-access-nr684\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.665090 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.665029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-dshm\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.665090 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.665055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60190a22-3d23-49ed-a39b-e1fba539d30f-tls-certs\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.665417 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.665390 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-tmp-dir\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.665489 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.665434 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-home\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.666054 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.666028 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-model-cache\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.667814 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.667759 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-dshm\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.667977 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.667959 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60190a22-3d23-49ed-a39b-e1fba539d30f-tls-certs\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.673656 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.673635 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr684\" (UniqueName: \"kubernetes.io/projected/60190a22-3d23-49ed-a39b-e1fba539d30f-kube-api-access-nr684\") pod \"auth-test-model-1ea658-kserve-6c8877c647-7nd6t\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.851122 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.851037 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:25.991314 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:25.991284 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t"] Jul 07 00:17:25.992284 ip-10-0-135-156 kubenswrapper[2556]: W0707 00:17:25.992254 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60190a22_3d23_49ed_a39b_e1fba539d30f.slice/crio-f2161a65fa73f2dbc21cdfd5c485fb9f6687980ae44389dd3cef341723518901 WatchSource:0}: Error finding container f2161a65fa73f2dbc21cdfd5c485fb9f6687980ae44389dd3cef341723518901: Status 404 returned error can't find the container with id f2161a65fa73f2dbc21cdfd5c485fb9f6687980ae44389dd3cef341723518901 Jul 07 00:17:26.704449 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:26.704416 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" event={"ID":"60190a22-3d23-49ed-a39b-e1fba539d30f","Type":"ContainerStarted","Data":"92c7573f12c49c313407f71ba63bdc244f06d14a9466f202c6d67615aac3b0ec"} Jul 07 00:17:26.704852 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:26.704464 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" event={"ID":"60190a22-3d23-49ed-a39b-e1fba539d30f","Type":"ContainerStarted","Data":"f2161a65fa73f2dbc21cdfd5c485fb9f6687980ae44389dd3cef341723518901"} Jul 07 00:17:26.722145 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:26.722098 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" podStartSLOduration=1.722084471 podStartE2EDuration="1.722084471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:17:26.720099138 +0000 UTC m=+2038.385274177" watchObservedRunningTime="2026-07-07 00:17:26.722084471 +0000 UTC m=+2038.387259509" Jul 07 00:17:29.221181 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:29.221150 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:17:35.852106 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:35.852072 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:35.852505 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:35.852123 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:35.865160 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:35.865133 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:36.780164 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:36.780121 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:17:45.025734 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:45.025700 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:17:59.722612 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:17:59.722529 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:18:13.818982 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:18:13.818948 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:18:29.256505 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:18:29.256474 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:18:44.018917 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:18:44.018881 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:18:59.825430 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:18:59.825398 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:19:12.216184 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:12.216146 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t"] Jul 07 00:19:16.024260 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:16.024224 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:19:27.236753 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.236704 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" podUID="60190a22-3d23-49ed-a39b-e1fba539d30f" containerName="main" containerID="cri-o://92c7573f12c49c313407f71ba63bdc244f06d14a9466f202c6d67615aac3b0ec" gracePeriod=45 Jul 07 00:19:27.364166 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.364131 2556 generic.go:356] "Generic (PLEG): container finished" podID="60190a22-3d23-49ed-a39b-e1fba539d30f" containerID="92c7573f12c49c313407f71ba63bdc244f06d14a9466f202c6d67615aac3b0ec" exitCode=0 Jul 07 00:19:27.364325 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.364228 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" event={"ID":"60190a22-3d23-49ed-a39b-e1fba539d30f","Type":"ContainerDied","Data":"92c7573f12c49c313407f71ba63bdc244f06d14a9466f202c6d67615aac3b0ec"} Jul 07 00:19:27.493156 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.493103 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:19:27.589097 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589060 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-home\") pod \"60190a22-3d23-49ed-a39b-e1fba539d30f\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " Jul 07 00:19:27.589301 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589112 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr684\" (UniqueName: \"kubernetes.io/projected/60190a22-3d23-49ed-a39b-e1fba539d30f-kube-api-access-nr684\") pod \"60190a22-3d23-49ed-a39b-e1fba539d30f\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " Jul 07 00:19:27.589301 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589138 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-model-cache\") pod \"60190a22-3d23-49ed-a39b-e1fba539d30f\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " Jul 07 00:19:27.589301 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589183 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-tmp-dir\") pod \"60190a22-3d23-49ed-a39b-e1fba539d30f\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " Jul 07 00:19:27.589301 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589230 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60190a22-3d23-49ed-a39b-e1fba539d30f-tls-certs\") pod \"60190a22-3d23-49ed-a39b-e1fba539d30f\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " Jul 07 00:19:27.589301 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589258 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-dshm\") pod \"60190a22-3d23-49ed-a39b-e1fba539d30f\" (UID: \"60190a22-3d23-49ed-a39b-e1fba539d30f\") " Jul 07 00:19:27.589516 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589352 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-home" (OuterVolumeSpecName: "home") pod "60190a22-3d23-49ed-a39b-e1fba539d30f" (UID: "60190a22-3d23-49ed-a39b-e1fba539d30f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:19:27.589516 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589474 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60190a22-3d23-49ed-a39b-e1fba539d30f" (UID: "60190a22-3d23-49ed-a39b-e1fba539d30f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:19:27.589516 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589485 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-home\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:19:27.589630 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.589485 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-model-cache" (OuterVolumeSpecName: "model-cache") pod "60190a22-3d23-49ed-a39b-e1fba539d30f" (UID: "60190a22-3d23-49ed-a39b-e1fba539d30f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:19:27.591560 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.591536 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-dshm" (OuterVolumeSpecName: "dshm") pod "60190a22-3d23-49ed-a39b-e1fba539d30f" (UID: "60190a22-3d23-49ed-a39b-e1fba539d30f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:19:27.591655 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.591561 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60190a22-3d23-49ed-a39b-e1fba539d30f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60190a22-3d23-49ed-a39b-e1fba539d30f" (UID: "60190a22-3d23-49ed-a39b-e1fba539d30f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:19:27.591655 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.591582 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60190a22-3d23-49ed-a39b-e1fba539d30f-kube-api-access-nr684" (OuterVolumeSpecName: "kube-api-access-nr684") pod "60190a22-3d23-49ed-a39b-e1fba539d30f" (UID: "60190a22-3d23-49ed-a39b-e1fba539d30f"). InnerVolumeSpecName "kube-api-access-nr684". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:19:27.690119 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.690090 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-tmp-dir\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:19:27.690119 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.690113 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60190a22-3d23-49ed-a39b-e1fba539d30f-tls-certs\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:19:27.690119 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.690121 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-dshm\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:19:27.690400 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.690131 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr684\" (UniqueName: \"kubernetes.io/projected/60190a22-3d23-49ed-a39b-e1fba539d30f-kube-api-access-nr684\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:19:27.690400 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:27.690139 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60190a22-3d23-49ed-a39b-e1fba539d30f-model-cache\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:19:28.373352 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:28.373307 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" event={"ID":"60190a22-3d23-49ed-a39b-e1fba539d30f","Type":"ContainerDied","Data":"f2161a65fa73f2dbc21cdfd5c485fb9f6687980ae44389dd3cef341723518901"} Jul 07 00:19:28.373814 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:28.373369 2556 scope.go:117] "RemoveContainer" containerID="92c7573f12c49c313407f71ba63bdc244f06d14a9466f202c6d67615aac3b0ec" Jul 07 00:19:28.373814 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:28.373321 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t" Jul 07 00:19:28.400694 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:28.400662 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t"] Jul 07 00:19:28.405117 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:28.405097 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/auth-test-model-1ea658-kserve-6c8877c647-7nd6t"] Jul 07 00:19:28.863347 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:28.863318 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60190a22-3d23-49ed-a39b-e1fba539d30f" path="/var/lib/kubelet/pods/60190a22-3d23-49ed-a39b-e1fba539d30f/volumes" Jul 07 00:19:29.081763 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:19:29.081734 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:20:01.139754 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.139720 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l"] Jul 07 00:20:01.140251 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.140095 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60190a22-3d23-49ed-a39b-e1fba539d30f" containerName="main" Jul 07 00:20:01.140251 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.140105 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="60190a22-3d23-49ed-a39b-e1fba539d30f" containerName="main" Jul 07 00:20:01.140251 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.140161 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="60190a22-3d23-49ed-a39b-e1fba539d30f" containerName="main" Jul 07 00:20:01.143138 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.143123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.145991 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.145967 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"sub-test-model-1ea658-kserve-self-signed-certs\"" Jul 07 00:20:01.147081 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.147063 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"openshift-service-ca.crt\"" Jul 07 00:20:01.147252 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.147230 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"default-dockercfg-c7s82\"" Jul 07 00:20:01.147399 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.147247 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"kube-root-ca.crt\"" Jul 07 00:20:01.153617 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.153592 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l"] Jul 07 00:20:01.273788 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.273758 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-model-cache\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.273957 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.273792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tmp-dir\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.273957 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.273833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58k5\" (UniqueName: \"kubernetes.io/projected/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-kube-api-access-k58k5\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.273957 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.273861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-dshm\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.273957 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.273877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tls-certs\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.273957 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.273940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-home\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375106 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-model-cache\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375106 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375109 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tmp-dir\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375369 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375136 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58k5\" (UniqueName: \"kubernetes.io/projected/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-kube-api-access-k58k5\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375369 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-dshm\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375369 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375225 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tls-certs\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375369 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375256 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-home\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375626 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375535 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tmp-dir\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375626 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375581 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-model-cache\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.375709 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.375697 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-home\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.377553 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.377532 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-dshm\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.377806 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.377786 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tls-certs\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.383288 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.383257 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58k5\" (UniqueName: \"kubernetes.io/projected/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-kube-api-access-k58k5\") pod \"sub-test-model-1ea658-kserve-577c5b748c-7h88l\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.453303 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.453280 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:01.590681 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:01.590656 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l"] Jul 07 00:20:01.592723 ip-10-0-135-156 kubenswrapper[2556]: W0707 00:20:01.592693 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cdc0027_42e0_462c_8ba7_bc90f0088eaa.slice/crio-6e5a264c3790ae0f9c278e9183a591db065522ed21b97a8628b1c3a5734c2244 WatchSource:0}: Error finding container 6e5a264c3790ae0f9c278e9183a591db065522ed21b97a8628b1c3a5734c2244: Status 404 returned error can't find the container with id 6e5a264c3790ae0f9c278e9183a591db065522ed21b97a8628b1c3a5734c2244 Jul 07 00:20:02.561253 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:02.561215 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" event={"ID":"5cdc0027-42e0-462c-8ba7-bc90f0088eaa","Type":"ContainerStarted","Data":"ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86"} Jul 07 00:20:02.561622 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:02.561267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" event={"ID":"5cdc0027-42e0-462c-8ba7-bc90f0088eaa","Type":"ContainerStarted","Data":"6e5a264c3790ae0f9c278e9183a591db065522ed21b97a8628b1c3a5734c2244"} Jul 07 00:20:02.582167 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:02.582125 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" podStartSLOduration=1.582111603 podStartE2EDuration="1.582111603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:02.581160234 +0000 UTC m=+2194.246335280" watchObservedRunningTime="2026-07-07 00:20:02.582111603 +0000 UTC m=+2194.247286641" Jul 07 00:20:05.339438 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:05.339398 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:20:11.453943 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:11.453902 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:11.454513 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:11.453964 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:11.467877 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:11.467852 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:11.621743 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:11.621717 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:20.830023 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:20.829989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:20:37.344374 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:37.344339 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l"] Jul 07 00:20:38.726339 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:38.726307 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:20:52.365258 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.365147 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" podUID="5cdc0027-42e0-462c-8ba7-bc90f0088eaa" containerName="main" containerID="cri-o://ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86" gracePeriod=45 Jul 07 00:20:52.615716 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.615662 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:52.701762 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.701734 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tmp-dir\") pod \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " Jul 07 00:20:52.701909 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.701779 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-home\") pod \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " Jul 07 00:20:52.701909 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.701803 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-model-cache\") pod \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " Jul 07 00:20:52.701909 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.701833 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k58k5\" (UniqueName: \"kubernetes.io/projected/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-kube-api-access-k58k5\") pod \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " Jul 07 00:20:52.702039 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702004 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tls-certs\") pod \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " Jul 07 00:20:52.702039 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702020 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5cdc0027-42e0-462c-8ba7-bc90f0088eaa" (UID: "5cdc0027-42e0-462c-8ba7-bc90f0088eaa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:20:52.702144 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702062 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-dshm\") pod \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\" (UID: \"5cdc0027-42e0-462c-8ba7-bc90f0088eaa\") " Jul 07 00:20:52.702144 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702079 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-home" (OuterVolumeSpecName: "home") pod "5cdc0027-42e0-462c-8ba7-bc90f0088eaa" (UID: "5cdc0027-42e0-462c-8ba7-bc90f0088eaa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:20:52.702144 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702115 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-model-cache" (OuterVolumeSpecName: "model-cache") pod "5cdc0027-42e0-462c-8ba7-bc90f0088eaa" (UID: "5cdc0027-42e0-462c-8ba7-bc90f0088eaa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:20:52.702363 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702345 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tmp-dir\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:20:52.702426 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702366 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-home\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:20:52.702426 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.702378 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-model-cache\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:20:52.704066 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.704039 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-kube-api-access-k58k5" (OuterVolumeSpecName: "kube-api-access-k58k5") pod "5cdc0027-42e0-462c-8ba7-bc90f0088eaa" (UID: "5cdc0027-42e0-462c-8ba7-bc90f0088eaa"). InnerVolumeSpecName "kube-api-access-k58k5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:20:52.704166 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.704083 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-dshm" (OuterVolumeSpecName: "dshm") pod "5cdc0027-42e0-462c-8ba7-bc90f0088eaa" (UID: "5cdc0027-42e0-462c-8ba7-bc90f0088eaa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:20:52.704251 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.704177 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5cdc0027-42e0-462c-8ba7-bc90f0088eaa" (UID: "5cdc0027-42e0-462c-8ba7-bc90f0088eaa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:20:52.805602 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.803781 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-dshm\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:20:52.805602 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.803826 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k58k5\" (UniqueName: \"kubernetes.io/projected/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-kube-api-access-k58k5\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:20:52.805602 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.803848 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdc0027-42e0-462c-8ba7-bc90f0088eaa-tls-certs\") on node \"ip-10-0-135-156.ec2.internal\" DevicePath \"\"" Jul 07 00:20:52.834802 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.834775 2556 generic.go:356] "Generic (PLEG): container finished" podID="5cdc0027-42e0-462c-8ba7-bc90f0088eaa" containerID="ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86" exitCode=0 Jul 07 00:20:52.834958 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.834827 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" event={"ID":"5cdc0027-42e0-462c-8ba7-bc90f0088eaa","Type":"ContainerDied","Data":"ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86"} Jul 07 00:20:52.834958 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.834843 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" Jul 07 00:20:52.834958 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.834858 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l" event={"ID":"5cdc0027-42e0-462c-8ba7-bc90f0088eaa","Type":"ContainerDied","Data":"6e5a264c3790ae0f9c278e9183a591db065522ed21b97a8628b1c3a5734c2244"} Jul 07 00:20:52.834958 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.834874 2556 scope.go:117] "RemoveContainer" containerID="ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86" Jul 07 00:20:52.844560 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.844543 2556 scope.go:117] "RemoveContainer" containerID="ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86" Jul 07 00:20:52.844812 ip-10-0-135-156 kubenswrapper[2556]: E0707 00:20:52.844794 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86\": container with ID starting with ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86 not found: ID does not exist" containerID="ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86" Jul 07 00:20:52.844868 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.844819 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86"} err="failed to get container status \"ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86\": rpc error: code = NotFound desc = could not find container \"ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86\": container with ID starting with ea81e0e22c77dd2c1fdf315d7e86569b27f9f98b27de3016e62a61c6e3b67c86 not found: ID does not exist" Jul 07 00:20:52.857023 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.856999 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l"] Jul 07 00:20:52.863477 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:52.863456 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/sub-test-model-1ea658-kserve-577c5b748c-7h88l"] Jul 07 00:20:54.156024 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:54.155987 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:20:54.863345 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:20:54.863313 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cdc0027-42e0-462c-8ba7-bc90f0088eaa" path="/var/lib/kubelet/pods/5cdc0027-42e0-462c-8ba7-bc90f0088eaa/volumes" Jul 07 00:21:05.441689 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:21:05.441656 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:21:23.732754 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:21:23.732714 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:21:29.053311 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:21:29.053283 2556 scope.go:117] "RemoveContainer" containerID="7feae4604e05f9acd0573a06175105320f8a52c623e43434f7ba79806658a016" Jul 07 00:21:29.061692 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:21:29.061676 2556 scope.go:117] "RemoveContainer" containerID="6ff12926e9ec987d5aa6f7f343cc16e27d2e68b5721346e2917a4af12fd1b6b4" Jul 07 00:21:50.342423 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:21:50.337833 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:22:03.743884 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:22:03.743847 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:22:16.326295 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:22:16.326262 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:22:58.936946 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:22:58.936913 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-999xb"] Jul 07 00:23:07.585844 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:07.585813 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5bsjz_1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937/manager/0.log" Jul 07 00:23:07.721339 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:07.721305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-686x8_25917143-35e0-4cb5-bee3-5ae8f9064557/manager/0.log" Jul 07 00:23:08.082260 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:08.082231 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-dtb6m_040d7a6c-94f6-41b0-9b21-384370474734/cleanup/0.log" Jul 07 00:23:08.692915 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:08.692892 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-lzgv9_017951a0-001c-4efb-8d9a-93f8a00109ac/copy-manifests/0.log" Jul 07 00:23:08.699257 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:08.699231 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-lzgv9_017951a0-001c-4efb-8d9a-93f8a00109ac/manager/0.log" Jul 07 00:23:09.744927 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:09.744897 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs_10e12467-a254-44b5-a8fc-fa4d64bf4d52/util/0.log" Jul 07 00:23:09.751153 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:09.751134 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs_10e12467-a254-44b5-a8fc-fa4d64bf4d52/pull/0.log" Jul 07 00:23:09.756866 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:09.756849 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs_10e12467-a254-44b5-a8fc-fa4d64bf4d52/extract/0.log" Jul 07 00:23:09.875145 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:09.875122 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq_a9dea464-3721-4802-9f6b-8453ef7d32fc/util/0.log" Jul 07 00:23:09.881848 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:09.881829 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq_a9dea464-3721-4802-9f6b-8453ef7d32fc/pull/0.log" Jul 07 00:23:09.889177 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:09.889161 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq_a9dea464-3721-4802-9f6b-8453ef7d32fc/extract/0.log" Jul 07 00:23:10.012491 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.012438 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts_5f40c598-3532-4d37-bb45-416815b66819/extract/0.log" Jul 07 00:23:10.019092 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.019077 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts_5f40c598-3532-4d37-bb45-416815b66819/util/0.log" Jul 07 00:23:10.025456 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.025432 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts_5f40c598-3532-4d37-bb45-416815b66819/pull/0.log" Jul 07 00:23:10.143757 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.143734 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd_79f9c8c8-5b56-42e9-8e60-48445c9a0aa8/util/0.log" Jul 07 00:23:10.149919 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.149901 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd_79f9c8c8-5b56-42e9-8e60-48445c9a0aa8/pull/0.log" Jul 07 00:23:10.157241 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.157211 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd_79f9c8c8-5b56-42e9-8e60-48445c9a0aa8/extract/0.log" Jul 07 00:23:10.517152 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.517125 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xgdrz_ed4d2e7c-47f6-445e-86c8-bc85e3140092/manager/0.log" Jul 07 00:23:10.883904 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:10.883831 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-527f7_b9aa061f-2f51-48ac-bee4-636e4806e93a/manager/0.log" Jul 07 00:23:11.007061 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:11.007036 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-999xb_59d67959-8eb8-4d1e-b83c-c4af26d644ee/limitador/0.log" Jul 07 00:23:11.127815 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:11.127792 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6qcqx_bcd47fe3-6833-4d14-afdf-bece4035c50e/manager/0.log" Jul 07 00:23:11.610727 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:11.610698 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xz2kc_e752d5c8-8f92-4e18-b2c3-86b67b0644c0/discovery/0.log" Jul 07 00:23:11.849365 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:11.849336 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-rpnc4_fd39d95d-41f4-44b4-ba1d-0b964b28d1cd/kube-auth-proxy/0.log" Jul 07 00:23:12.925377 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:12.925337 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8mkh6_5a4520b3-4f37-4d8d-a207-e91ad3042f55/main/0.log" Jul 07 00:23:20.271904 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:20.271872 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6dxdx_fce18fdc-bd9b-4997-8937-d927ec259001/global-pull-secret-syncer/0.log" Jul 07 00:23:20.481723 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:20.481693 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w66wc_cf87aa93-c0c4-49ad-abed-995d38a63e6b/konnectivity-agent/0.log" Jul 07 00:23:20.577555 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:20.577476 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-156.ec2.internal_92840009ecdd9bea75a49d7eefaa1ddc/haproxy/0.log" Jul 07 00:23:24.347867 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.347841 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs_10e12467-a254-44b5-a8fc-fa4d64bf4d52/extract/0.log" Jul 07 00:23:24.370116 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.370098 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs_10e12467-a254-44b5-a8fc-fa4d64bf4d52/util/0.log" Jul 07 00:23:24.391696 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.391678 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pbfzs_10e12467-a254-44b5-a8fc-fa4d64bf4d52/pull/0.log" Jul 07 00:23:24.421424 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.421399 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq_a9dea464-3721-4802-9f6b-8453ef7d32fc/extract/0.log" Jul 07 00:23:24.441827 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.441806 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq_a9dea464-3721-4802-9f6b-8453ef7d32fc/util/0.log" Jul 07 00:23:24.465150 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.465133 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwrcq_a9dea464-3721-4802-9f6b-8453ef7d32fc/pull/0.log" Jul 07 00:23:24.492625 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.492605 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts_5f40c598-3532-4d37-bb45-416815b66819/extract/0.log" Jul 07 00:23:24.513839 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.513823 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts_5f40c598-3532-4d37-bb45-416815b66819/util/0.log" Jul 07 00:23:24.535380 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.535355 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rf2ts_5f40c598-3532-4d37-bb45-416815b66819/pull/0.log" Jul 07 00:23:24.561629 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.561612 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd_79f9c8c8-5b56-42e9-8e60-48445c9a0aa8/extract/0.log" Jul 07 00:23:24.582266 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.582245 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd_79f9c8c8-5b56-42e9-8e60-48445c9a0aa8/util/0.log" Jul 07 00:23:24.606091 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.606031 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19mdnd_79f9c8c8-5b56-42e9-8e60-48445c9a0aa8/pull/0.log" Jul 07 00:23:24.933968 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:24.933941 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xgdrz_ed4d2e7c-47f6-445e-86c8-bc85e3140092/manager/0.log" Jul 07 00:23:25.137012 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:25.136973 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-527f7_b9aa061f-2f51-48ac-bee4-636e4806e93a/manager/0.log" Jul 07 00:23:25.173928 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:25.173902 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-999xb_59d67959-8eb8-4d1e-b83c-c4af26d644ee/limitador/0.log" Jul 07 00:23:25.233686 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:25.233622 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6qcqx_bcd47fe3-6833-4d14-afdf-bece4035c50e/manager/0.log" Jul 07 00:23:27.096657 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.096630 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mkbr9_c0bff359-d95f-47d8-bdc4-51c00eca4ce6/kube-state-metrics/0.log" Jul 07 00:23:27.115165 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.115143 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mkbr9_c0bff359-d95f-47d8-bdc4-51c00eca4ce6/kube-rbac-proxy-main/0.log" Jul 07 00:23:27.137151 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.137130 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mkbr9_c0bff359-d95f-47d8-bdc4-51c00eca4ce6/kube-rbac-proxy-self/0.log" Jul 07 00:23:27.172762 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.172744 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d96c79f7d-5tsp6_4aee3d7b-3720-44b5-9fad-25a77b7cecd1/metrics-server/0.log" Jul 07 00:23:27.437916 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.437886 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7crt_14b1ea91-76fb-47e4-b343-b3b02748c981/node-exporter/0.log" Jul 07 00:23:27.474360 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.474334 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7crt_14b1ea91-76fb-47e4-b343-b3b02748c981/kube-rbac-proxy/0.log" Jul 07 00:23:27.496187 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.496169 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7crt_14b1ea91-76fb-47e4-b343-b3b02748c981/init-textfile/0.log" Jul 07 00:23:27.538908 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.538882 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s8wh4_6245d8bc-cfa0-4153-a2ed-0a199b03606b/kube-rbac-proxy-main/0.log" Jul 07 00:23:27.562884 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.562848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s8wh4_6245d8bc-cfa0-4153-a2ed-0a199b03606b/kube-rbac-proxy-self/0.log" Jul 07 00:23:27.601035 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.601013 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s8wh4_6245d8bc-cfa0-4153-a2ed-0a199b03606b/openshift-state-metrics/0.log" Jul 07 00:23:27.903664 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.903635 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-p8ft5_e16eede5-4a81-4edb-aa79-84fa44c4c9d0/prometheus-operator-admission-webhook/0.log" Jul 07 00:23:27.952234 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:27.952188 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b4d978b59-7rh8d_8aafafe8-525c-4837-934f-d10005ad5f84/telemeter-client/0.log" Jul 07 00:23:28.023305 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.023281 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b4d978b59-7rh8d_8aafafe8-525c-4837-934f-d10005ad5f84/reload/0.log" Jul 07 00:23:28.057329 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.057297 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b4d978b59-7rh8d_8aafafe8-525c-4837-934f-d10005ad5f84/kube-rbac-proxy/0.log" Jul 07 00:23:28.101069 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.101046 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc99c7475-dlpz7_20f66b77-ca63-4ec5-9cc2-2950dfad2be7/thanos-query/0.log" Jul 07 00:23:28.140937 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.140915 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc99c7475-dlpz7_20f66b77-ca63-4ec5-9cc2-2950dfad2be7/kube-rbac-proxy-web/0.log" Jul 07 00:23:28.163263 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.163183 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc99c7475-dlpz7_20f66b77-ca63-4ec5-9cc2-2950dfad2be7/kube-rbac-proxy/0.log" Jul 07 00:23:28.186571 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.186551 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc99c7475-dlpz7_20f66b77-ca63-4ec5-9cc2-2950dfad2be7/prom-label-proxy/0.log" Jul 07 00:23:28.210031 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.210013 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc99c7475-dlpz7_20f66b77-ca63-4ec5-9cc2-2950dfad2be7/kube-rbac-proxy-rules/0.log" Jul 07 00:23:28.236861 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:28.236845 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc99c7475-dlpz7_20f66b77-ca63-4ec5-9cc2-2950dfad2be7/kube-rbac-proxy-metrics/0.log" Jul 07 00:23:30.482544 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.482512 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9"] Jul 07 00:23:30.483027 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.483005 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc0027-42e0-462c-8ba7-bc90f0088eaa" containerName="main" Jul 07 00:23:30.483166 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.483029 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc0027-42e0-462c-8ba7-bc90f0088eaa" containerName="main" Jul 07 00:23:30.483166 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.483140 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cdc0027-42e0-462c-8ba7-bc90f0088eaa" containerName="main" Jul 07 00:23:30.486769 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.486751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.489111 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.489088 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmw4w\"/\"kube-root-ca.crt\"" Jul 07 00:23:30.490013 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.489988 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmw4w\"/\"openshift-service-ca.crt\"" Jul 07 00:23:30.490107 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.489993 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tmw4w\"/\"default-dockercfg-gdztz\"" Jul 07 00:23:30.497348 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.497328 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9"] Jul 07 00:23:30.539143 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.539117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-sys\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.539279 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.539144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj4mq\" (UniqueName: \"kubernetes.io/projected/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-kube-api-access-vj4mq\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.539279 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.539171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-podres\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.539279 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.539259 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-proc\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.539394 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.539294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-lib-modules\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640265 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640234 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-proc\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640376 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640277 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-lib-modules\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640376 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640347 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-proc\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640445 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-sys\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640445 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640406 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-lib-modules\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640445 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj4mq\" (UniqueName: \"kubernetes.io/projected/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-kube-api-access-vj4mq\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640540 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640445 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-sys\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640540 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-podres\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.640615 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.640602 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-podres\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.648152 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.648124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj4mq\" (UniqueName: \"kubernetes.io/projected/842ec28e-d4ce-4d52-83c5-000ad6bfbae8-kube-api-access-vj4mq\") pod \"perf-node-gather-daemonset-xhdf9\" (UID: \"842ec28e-d4ce-4d52-83c5-000ad6bfbae8\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.761925 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.761852 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b5754c5bd-5zv7s_0fa51485-dc63-4252-be87-65594397dcfa/console/0.log" Jul 07 00:23:30.797793 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.797770 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:30.928392 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:30.928366 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9"] Jul 07 00:23:30.930017 ip-10-0-135-156 kubenswrapper[2556]: W0707 00:23:30.929992 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod842ec28e_d4ce_4d52_83c5_000ad6bfbae8.slice/crio-313636f424c8386251d6726f7aec053c0436ea954adfdbec5a98173b418328f3 WatchSource:0}: Error finding container 313636f424c8386251d6726f7aec053c0436ea954adfdbec5a98173b418328f3: Status 404 returned error can't find the container with id 313636f424c8386251d6726f7aec053c0436ea954adfdbec5a98173b418328f3 Jul 07 00:23:31.704441 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:31.704405 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" event={"ID":"842ec28e-d4ce-4d52-83c5-000ad6bfbae8","Type":"ContainerStarted","Data":"1801f1d1fac20739a90250b5b0f82ce5523b899f90ce2e5bb146221bdcc6c376"} Jul 07 00:23:31.704839 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:31.704462 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" event={"ID":"842ec28e-d4ce-4d52-83c5-000ad6bfbae8","Type":"ContainerStarted","Data":"313636f424c8386251d6726f7aec053c0436ea954adfdbec5a98173b418328f3"} Jul 07 00:23:31.704839 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:31.704542 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:31.723224 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:31.723162 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" podStartSLOduration=1.7231502779999999 podStartE2EDuration="1.723150278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:23:31.720594252 +0000 UTC m=+2403.385769311" watchObservedRunningTime="2026-07-07 00:23:31.723150278 +0000 UTC m=+2403.388325294" Jul 07 00:23:32.563049 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:32.563018 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfffx_8b080658-9569-47e1-80e1-d828660d3e4d/dns/0.log" Jul 07 00:23:32.584311 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:32.584287 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfffx_8b080658-9569-47e1-80e1-d828660d3e4d/kube-rbac-proxy/0.log" Jul 07 00:23:32.682045 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:32.682016 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dt5dc_5ff1387c-c93b-4550-b362-40131faadbb7/dns-node-resolver/0.log" Jul 07 00:23:33.337315 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:33.337279 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x7v8t_02ff99e6-eed4-4326-8a58-dcec0181dbdf/node-ca/0.log" Jul 07 00:23:34.425580 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:34.425555 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xz2kc_e752d5c8-8f92-4e18-b2c3-86b67b0644c0/discovery/0.log" Jul 07 00:23:34.476394 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:34.476373 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-rpnc4_fd39d95d-41f4-44b4-ba1d-0b964b28d1cd/kube-auth-proxy/0.log" Jul 07 00:23:35.373123 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:35.373093 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f9gjs_16c9b08e-3fce-481a-a014-3979292c5e15/serve-healthcheck-canary/0.log" Jul 07 00:23:35.947755 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:35.947725 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b45pp_ceb523eb-2f3e-4180-a331-fc097950d160/kube-rbac-proxy/0.log" Jul 07 00:23:35.967952 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:35.967927 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b45pp_ceb523eb-2f3e-4180-a331-fc097950d160/exporter/0.log" Jul 07 00:23:35.988316 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:35.988292 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b45pp_ceb523eb-2f3e-4180-a331-fc097950d160/extractor/0.log" Jul 07 00:23:37.719483 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:37.719460 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-xhdf9" Jul 07 00:23:38.169422 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:38.169391 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5bsjz_1f4d3bcb-76e8-4c58-a7c0-ca9d5b727937/manager/0.log" Jul 07 00:23:38.304471 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:38.304440 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-686x8_25917143-35e0-4cb5-bee3-5ae8f9064557/manager/0.log" Jul 07 00:23:38.396590 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:38.396565 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-dtb6m_040d7a6c-94f6-41b0-9b21-384370474734/cleanup/0.log" Jul 07 00:23:38.819516 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:38.819487 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-lzgv9_017951a0-001c-4efb-8d9a-93f8a00109ac/manager/0.log" Jul 07 00:23:38.839094 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:38.839073 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-lzgv9_017951a0-001c-4efb-8d9a-93f8a00109ac/copy-manifests/0.log" Jul 07 00:23:40.306214 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:40.306163 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-sxc2c_2b4afa52-4b1c-451b-9126-d010ea51fdc3/openshift-lws-operator/0.log" Jul 07 00:23:41.182351 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:41.182324 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xz2kc_e752d5c8-8f92-4e18-b2c3-86b67b0644c0/discovery/0.log" Jul 07 00:23:41.210564 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:41.210539 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-rpnc4_fd39d95d-41f4-44b4-ba1d-0b964b28d1cd/kube-auth-proxy/0.log" Jul 07 00:23:42.718321 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:42.718293 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xz2kc_e752d5c8-8f92-4e18-b2c3-86b67b0644c0/discovery/0.log" Jul 07 00:23:42.749978 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:42.749953 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-rpnc4_fd39d95d-41f4-44b4-ba1d-0b964b28d1cd/kube-auth-proxy/0.log" Jul 07 00:23:47.174935 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.174902 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4dzf_b60a980f-e9bb-4213-bf7c-1eea2faab280/kube-multus-additional-cni-plugins/0.log" Jul 07 00:23:47.198520 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.198496 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4dzf_b60a980f-e9bb-4213-bf7c-1eea2faab280/egress-router-binary-copy/0.log" Jul 07 00:23:47.219829 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.219809 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4dzf_b60a980f-e9bb-4213-bf7c-1eea2faab280/cni-plugins/0.log" Jul 07 00:23:47.240107 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.240090 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4dzf_b60a980f-e9bb-4213-bf7c-1eea2faab280/bond-cni-plugin/0.log" Jul 07 00:23:47.260102 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.260088 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4dzf_b60a980f-e9bb-4213-bf7c-1eea2faab280/routeoverride-cni/0.log" Jul 07 00:23:47.283315 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.283301 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4dzf_b60a980f-e9bb-4213-bf7c-1eea2faab280/whereabouts-cni-bincopy/0.log" Jul 07 00:23:47.305468 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.305444 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4dzf_b60a980f-e9bb-4213-bf7c-1eea2faab280/whereabouts-cni/0.log" Jul 07 00:23:47.495282 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.495210 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f7279_a3a5678c-ebba-4ced-b5b7-8355497bc2b6/kube-multus/0.log" Jul 07 00:23:47.537711 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.537689 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4gcnp_97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f/network-metrics-daemon/0.log" Jul 07 00:23:47.555939 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:47.555912 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4gcnp_97e6a5df-1ecd-4aeb-90d9-b07ea0fbd13f/kube-rbac-proxy/0.log" Jul 07 00:23:48.417466 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.417436 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/ovn-controller/0.log" Jul 07 00:23:48.433729 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.433709 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/ovn-acl-logging/0.log" Jul 07 00:23:48.455436 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.455415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/kube-rbac-proxy-node/0.log" Jul 07 00:23:48.478233 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.478182 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 00:23:48.501876 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.501853 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/northd/0.log" Jul 07 00:23:48.524166 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.524143 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/nbdb/0.log" Jul 07 00:23:48.550052 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.550033 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/sbdb/0.log" Jul 07 00:23:48.603880 ip-10-0-135-156 kubenswrapper[2556]: I0707 00:23:48.603859 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-45k2f_83f9cf67-e98c-43ea-a3f6-c6b56fea1cd3/ovnkube-controller/0.log"