Sep 10 17:37:51.820743 ip-10-0-129-36 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 17:37:51.820755 ip-10-0-129-36 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 17:37:51.820764 ip-10-0-129-36 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 17:37:51.820978 ip-10-0-129-36 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 17:38:03.319821 ip-10-0-129-36 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 17:38:03.319834 ip-10-0-129-36 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eec3383bcee34465b5eeb42fa29582cc -- Sep 10 17:39:35.364232 ip-10-0-129-36 systemd[1]: Starting Kubernetes Kubelet... Sep 10 17:39:35.756791 ip-10-0-129-36 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:39:35.756791 ip-10-0-129-36 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 17:39:35.756791 ip-10-0-129-36 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:39:35.756791 ip-10-0-129-36 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 17:39:35.756791 ip-10-0-129-36 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:39:35.757532 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.756820 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 17:39:35.760544 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760526 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:35.760544 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760542 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:35.760544 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760546 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760549 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760553 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760555 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760558 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760561 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760564 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760566 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760569 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760572 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760574 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760577 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760580 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760582 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760585 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760590 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760594 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760597 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760605 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760608 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:35.760632 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760610 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760613 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760616 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760618 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760621 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760625 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760628 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760630 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760633 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760637 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760640 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760643 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760646 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760648 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760651 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760654 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760656 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760659 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760661 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:35.761143 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760665 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760670 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760673 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760676 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760679 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760682 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760684 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760687 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760690 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760693 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760696 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760698 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760707 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760710 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760713 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760716 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760719 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760722 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760725 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:35.761599 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760727 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760730 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760733 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760736 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760740 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760743 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760746 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760749 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760752 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760755 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760758 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760760 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760763 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760766 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760769 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760771 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760774 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760776 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760779 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:35.762095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760781 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760784 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760786 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760789 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760791 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760794 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760796 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760806 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760808 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760811 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760814 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760817 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760820 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760822 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760825 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760827 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760830 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760832 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760835 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.760837 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:35.762555 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761612 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761620 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761622 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761625 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761628 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761630 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761633 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761636 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761638 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761641 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761644 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761646 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761649 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761652 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761655 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761658 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761660 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761663 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761666 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761669 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:35.763069 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761679 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761682 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761684 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761687 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761689 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761692 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761695 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761697 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761700 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761702 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761705 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761708 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761710 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761713 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761715 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761718 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761724 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761727 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761729 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761732 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:35.763606 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761734 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761737 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761740 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761742 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761744 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761747 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761749 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761752 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761755 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761761 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761765 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761768 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761770 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761779 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761781 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761784 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761787 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761789 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761793 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:35.764117 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761795 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761798 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761800 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761803 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761806 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761808 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761811 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761813 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761816 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761819 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761823 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761826 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761829 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761832 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761835 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761837 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761840 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761842 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761845 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:35.764591 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761847 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761850 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761853 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761858 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761862 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761865 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761867 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761870 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761880 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761883 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761887 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761889 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761892 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761895 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761897 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761900 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761903 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761907 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761909 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761912 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:35.765078 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.761915 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762402 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762408 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762411 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762414 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762416 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762420 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762422 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762425 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762428 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762430 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762433 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762436 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762439 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762441 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762445 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762448 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762451 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762454 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762456 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:35.765570 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762465 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762467 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762470 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762472 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762475 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762478 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762481 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762483 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762486 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762491 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762493 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762496 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762498 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762501 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762504 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762506 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762509 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762513 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762518 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:35.766076 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762521 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762524 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762527 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762530 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762533 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762536 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762539 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762541 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762545 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762547 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762550 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762552 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762555 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762558 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762566 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762569 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762572 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762575 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762577 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762580 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:35.766537 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762583 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762585 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762588 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762591 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762594 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762596 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762599 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762601 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762604 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762607 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762609 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762611 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762614 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762617 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762619 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762622 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762624 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762627 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762629 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762632 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:35.767033 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762635 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762638 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762641 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762643 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762647 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762650 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762653 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762662 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762665 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762668 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762670 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762673 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762675 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762678 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762681 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762683 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762686 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762689 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762691 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:35.767515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762694 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.762696 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762767 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762813 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762820 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762824 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762829 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762832 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762836 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762841 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762844 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762847 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762850 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762854 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762857 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762860 2580 flags.go:64] FLAG: --cgroup-root="" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762864 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762867 2580 flags.go:64] FLAG: --client-ca-file="" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762870 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762873 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762881 2580 flags.go:64] FLAG: --cluster-domain="" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762889 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762893 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762896 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 17:39:35.768007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762899 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762903 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762906 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762909 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762913 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762916 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762932 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762935 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762938 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762941 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762945 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762948 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762951 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762954 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762957 2580 flags.go:64] FLAG: --enable-server="true" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762960 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762967 2580 flags.go:64] FLAG: --event-burst="100" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762971 2580 flags.go:64] FLAG: --event-qps="50" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762974 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762977 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762980 2580 flags.go:64] FLAG: --eviction-hard="" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762984 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762987 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762990 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762993 2580 flags.go:64] FLAG: --eviction-soft="" Sep 10 17:39:35.768632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762996 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.762999 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763002 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763005 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763007 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763018 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763021 2580 flags.go:64] FLAG: --feature-gates="" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763025 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763028 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763031 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763034 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763037 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763040 2580 flags.go:64] FLAG: --help="false" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763043 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-129-36.ec2.internal" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763046 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763049 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763052 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763055 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763058 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763061 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763064 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763067 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763070 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 17:39:35.769288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763073 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763076 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763080 2580 flags.go:64] FLAG: --kube-reserved="" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763083 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763085 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763089 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763091 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763094 2580 flags.go:64] FLAG: --lock-file="" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763097 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763102 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763105 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763110 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763113 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763116 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763118 2580 flags.go:64] FLAG: --logging-format="text" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763127 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763131 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763133 2580 flags.go:64] FLAG: --manifest-url="" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763136 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763141 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763157 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763162 2580 flags.go:64] FLAG: --max-pods="110" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763165 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763169 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763172 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 17:39:35.769877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763174 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763177 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763180 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763183 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763190 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763193 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763196 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763199 2580 flags.go:64] FLAG: --pod-cidr="" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763203 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763209 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763212 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763215 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763218 2580 flags.go:64] FLAG: --port="10250" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763221 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763224 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-017a0da10f13e77e3" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763234 2580 flags.go:64] FLAG: --qos-reserved="" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763238 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763241 2580 flags.go:64] FLAG: --register-node="true" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763244 2580 flags.go:64] FLAG: --register-with-taints="" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763248 2580 flags.go:64] FLAG: --registry-burst="10" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763251 2580 flags.go:64] FLAG: --registry-qps="5" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763254 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763256 2580 flags.go:64] FLAG: --reserved-memory="" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763266 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763269 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 17:39:35.770854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763272 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763275 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763278 2580 flags.go:64] FLAG: --runonce="false" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763280 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763283 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763286 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763289 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763292 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763295 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763298 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763301 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763304 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763307 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763310 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763313 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763316 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763320 2580 flags.go:64] FLAG: --system-cgroups="" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763323 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763328 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763331 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763334 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763341 2580 flags.go:64] FLAG: --tls-min-version="" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763344 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763348 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763351 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 17:39:35.771818 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763354 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763357 2580 flags.go:64] FLAG: --v="2" Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763361 2580 flags.go:64] FLAG: --version="false" Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763365 2580 flags.go:64] FLAG: --vmodule="" Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763369 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.763372 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763555 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763561 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763564 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763567 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763570 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763572 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763575 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763578 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763581 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763583 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763587 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763590 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763592 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763595 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763598 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:35.772495 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763601 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763603 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763607 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763610 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763613 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763616 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763619 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763622 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763624 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763628 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763631 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763634 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763636 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763639 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763641 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763644 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763646 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763649 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763665 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763668 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:35.773039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763670 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763674 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763678 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763681 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763684 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763687 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763689 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763692 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763695 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763697 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763700 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763702 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763705 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763708 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763711 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763714 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763717 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763719 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763722 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763725 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:35.773528 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763728 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763732 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763734 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763737 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763740 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763742 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763745 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763748 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763750 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763753 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763756 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763764 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763767 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763771 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763775 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763778 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763781 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763784 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763788 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:35.774036 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763792 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763795 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763797 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763800 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763803 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763805 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763808 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763812 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763815 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763817 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763820 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763822 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763825 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763827 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763831 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763834 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763836 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763839 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763841 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763844 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:35.774510 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763846 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763849 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763852 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763854 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.763857 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.764468 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.773207 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.773224 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.774584 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.774596 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774663 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774670 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774673 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774677 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774681 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:35.775023 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774683 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774686 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774689 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774692 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774695 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774697 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774702 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774706 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774709 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774717 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774720 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774724 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774728 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774731 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774734 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774737 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774740 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774742 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774745 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:35.775405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774747 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774750 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774753 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774755 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774758 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774761 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774764 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774767 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774769 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774772 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774775 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774778 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774780 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774783 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774786 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774788 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774791 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774793 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774796 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774799 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:35.775897 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774802 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774804 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774813 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774816 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774819 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774821 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774824 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774827 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774829 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774832 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774835 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774838 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774840 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774843 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774845 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774848 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774851 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774854 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774857 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:35.776399 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774860 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774862 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774865 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774868 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774870 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774873 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774876 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774878 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774882 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774885 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774888 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774891 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774894 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774897 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774900 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774902 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774911 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774914 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774917 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:35.776857 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774932 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774935 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774938 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774941 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774943 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774946 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774949 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774952 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774954 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774957 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774960 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774963 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774966 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774969 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774971 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774974 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:35.777371 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.774977 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.774982 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775113 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775118 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775121 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775125 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775127 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775130 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775133 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775136 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775139 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775141 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775144 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775147 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775151 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:35.777793 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775154 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775157 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775159 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775162 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775165 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775167 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775170 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775173 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775175 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775180 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775183 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775187 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775189 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775193 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775196 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775198 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775201 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775204 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775206 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:35.778198 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775209 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775212 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775215 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775217 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775220 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775222 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775225 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775228 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775231 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775235 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775238 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775241 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775244 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775247 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775250 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775253 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775256 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775258 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775261 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775263 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:35.778668 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775266 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775268 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775271 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775274 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775276 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775279 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775282 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775285 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775287 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775290 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775292 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775295 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775298 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775301 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775304 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775306 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775310 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775313 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775320 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:35.779177 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775323 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775325 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775328 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775330 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775333 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775335 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775338 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775341 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775344 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775347 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775349 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775352 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775354 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775357 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775359 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775362 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775365 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775367 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775370 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775372 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:35.779644 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775376 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775378 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775381 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775383 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775386 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775389 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775392 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:35.775394 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.775399 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.775515 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.777562 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.778417 2580 server.go:1019] "Starting client certificate rotation" Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.778521 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:39:35.780141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.778561 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:39:35.780757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.780740 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:39:35.781893 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.781875 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:39:35.791184 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.791162 2580 log.go:25] "Validated CRI v1 runtime API" Sep 10 17:39:35.793947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.793931 2580 log.go:25] "Validated CRI v1 image API" Sep 10 17:39:35.794840 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.794820 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 17:39:35.799402 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.799383 2580 fs.go:135] Filesystem UUIDs: map[07c12dd8-b18a-41b4-a573-661eef3718a6:/dev/nvme0n1p4 374e9f6c-ea20-4ba8-8ce9-91e599956eb4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 10 17:39:35.799468 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.799401 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 17:39:35.804267 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.804154 2580 manager.go:216] Machine: {Timestamp:2026-09-10 17:39:35.802853079 +0000 UTC m=+0.315334993 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096815 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd7ecfcd82b3e252a1fee4a776826 SystemUUID:ec2dd7ec-fcd8-2b3e-252a-1fee4a776826 BootID:eec3383b-cee3-4465-b5ee-b42fa29582cc Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:2a:d3:c8:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:2a:d3:c8:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:6e:25:e1:76:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 17:39:35.804267 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.804263 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 17:39:35.804394 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.804374 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 17:39:35.807407 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.807379 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 17:39:35.807570 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.807407 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 17:39:35.808154 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.808143 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 17:39:35.808194 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.808156 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 17:39:35.808194 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.808164 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:39:35.808876 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.808867 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:39:35.809623 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.809613 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 17:39:35.813272 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813259 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:39:35.813390 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813381 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 17:39:35.813429 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813415 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 10 17:39:35.813429 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813424 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 17:39:35.813496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813439 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 17:39:35.813496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813448 2580 kubelet.go:398] "Adding apiserver pod source" Sep 10 17:39:35.813496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813457 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 17:39:35.813833 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813822 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:39:35.813871 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.813839 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:39:35.816104 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.816084 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 17:39:35.818265 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.818251 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 17:39:35.818330 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.818281 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 17:39:35.819325 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819313 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819329 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819335 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819340 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819350 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819358 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819378 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819384 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819391 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 17:39:35.819393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819397 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 17:39:35.819638 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819406 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 17:39:35.819638 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.819411 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 17:39:35.820361 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.820348 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 17:39:35.820361 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.820359 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 17:39:35.824181 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.824167 2580 server.go:1268] "Started kubelet" Sep 10 17:39:35.824315 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.824246 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 17:39:35.824354 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.824337 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 17:39:35.824933 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.824817 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 17:39:35.824980 ip-10-0-129-36 systemd[1]: Started Kubernetes Kubelet. Sep 10 17:39:35.825631 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.825614 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 17:39:35.827671 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.827001 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 10 17:39:35.828745 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.828726 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 17:39:35.829635 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.829621 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 17:39:35.830202 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.830179 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 17:39:35.830261 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.830226 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 17:39:35.831099 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.830089 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-36.ec2.internal.18d406635e280825 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-36.ec2.internal,UID:ip-10-0-129-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-36.ec2.internal,},FirstTimestamp:2026-09-10 17:39:35.824140325 +0000 UTC m=+0.336622240,LastTimestamp:2026-09-10 17:39:35.824140325 +0000 UTC m=+0.336622240,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-36.ec2.internal,}" Sep 10 17:39:35.831908 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.831894 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:39:35.832807 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.832110 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 17:39:35.832807 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.832116 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 17:39:35.832807 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.832219 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:35.832995 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.832840 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 17:39:35.833622 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.833532 2580 factory.go:55] Registering systemd factory Sep 10 17:39:35.833622 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.833551 2580 factory.go:223] Registration of the systemd container factory successfully Sep 10 17:39:35.833754 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.833740 2580 factory.go:153] Registering CRI-O factory Sep 10 17:39:35.833792 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.833758 2580 factory.go:223] Registration of the crio container factory successfully Sep 10 17:39:35.833841 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.833830 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 17:39:35.833881 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.833852 2580 factory.go:103] Registering Raw factory Sep 10 17:39:35.833881 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.833868 2580 manager.go:1196] Started watching for new ooms in manager Sep 10 17:39:35.834321 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.834300 2580 manager.go:349] Starting recovery of all containers Sep 10 17:39:35.834874 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.834858 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 17:39:35.834913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.834880 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 17:39:35.835487 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.835461 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 17:39:35.835656 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.835633 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 17:39:35.835821 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.835802 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 10 17:39:35.835821 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.835821 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 10 17:39:35.846475 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.846455 2580 manager.go:354] Recovery completed Sep 10 17:39:35.850640 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.850624 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:35.852553 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.852530 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:35.852634 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.852570 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:35.852634 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.852586 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:35.853321 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.853304 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 17:39:35.853321 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.853318 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 17:39:35.853446 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.853335 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:39:35.853446 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.853357 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:35.854277 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.854261 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:35.854347 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.854287 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:35.854347 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.854300 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:35.855530 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.855515 2580 policy_none.go:49] "None policy: Start" Sep 10 17:39:35.855530 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.855530 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 17:39:35.855669 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.855540 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 17:39:35.856182 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.856117 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-36.ec2.internal.18d406635fd9916f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-36.ec2.internal,UID:ip-10-0-129-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-36.ec2.internal,},FirstTimestamp:2026-09-10 17:39:35.852552559 +0000 UTC m=+0.365034474,LastTimestamp:2026-09-10 17:39:35.852552559 +0000 UTC m=+0.365034474,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-36.ec2.internal,}" Sep 10 17:39:35.857576 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.857560 2580 policy_none.go:47] "Start" Sep 10 17:39:35.865149 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.865066 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-36.ec2.internal.18d406635fd9f46b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-36.ec2.internal,UID:ip-10-0-129-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-36.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-36.ec2.internal,},FirstTimestamp:2026-09-10 17:39:35.852577899 +0000 UTC m=+0.365059816,LastTimestamp:2026-09-10 17:39:35.852577899 +0000 UTC m=+0.365059816,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-36.ec2.internal,}" Sep 10 17:39:35.867798 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.867777 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-92s9g" Sep 10 17:39:35.875686 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.875662 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-92s9g" Sep 10 17:39:35.876648 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.876563 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-36.ec2.internal.18d406635fda29c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-36.ec2.internal,UID:ip-10-0-129-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-36.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-36.ec2.internal,},FirstTimestamp:2026-09-10 17:39:35.852591559 +0000 UTC m=+0.365073474,LastTimestamp:2026-09-10 17:39:35.852591559 +0000 UTC m=+0.365073474,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-36.ec2.internal,}" Sep 10 17:39:35.898572 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.898553 2580 manager.go:337] "Starting Device Plugin manager" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.898600 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.898614 2580 server.go:87] "Starting device plugin registration server" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.898888 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.898898 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.899050 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.899119 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.899127 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.900551 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 17:39:35.911297 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.900605 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:35.929136 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.929107 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 17:39:35.930344 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.930326 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 17:39:35.930441 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.930387 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 17:39:35.930441 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.930415 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 17:39:35.930534 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:35.930461 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 17:39:35.933699 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.933673 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:35.999027 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:35.998990 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:36.000106 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.000080 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:36.000203 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.000119 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:36.000203 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.000133 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:36.000203 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.000156 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.007433 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.007370 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.007433 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.007401 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-36.ec2.internal\": node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:36.030729 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.030706 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal"] Sep 10 17:39:36.030833 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.030792 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:36.032591 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.032576 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:36.032667 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.032604 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:36.032667 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.032614 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:36.035390 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.035375 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:36.035548 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.035535 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.035587 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.035581 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:36.035669 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.035647 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:36.036393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d40ac0b32353563b61c22e4118001d86-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"d40ac0b32353563b61c22e4118001d86\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.036476 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d40ac0b32353563b61c22e4118001d86-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"d40ac0b32353563b61c22e4118001d86\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.036784 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036768 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:36.036837 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036799 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:36.036837 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036813 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:36.036913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036881 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:36.036913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036904 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:36.036913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.036913 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:36.038886 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.038872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.038942 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.038896 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:36.039966 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.039947 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:36.040067 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.039976 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:36.040067 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.039997 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:36.064598 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.064576 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-36.ec2.internal\" not found" node="ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.068877 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.068861 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-36.ec2.internal\" not found" node="ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.136703 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.136671 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:36.136829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.136708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d40ac0b32353563b61c22e4118001d86-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"d40ac0b32353563b61c22e4118001d86\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.136829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.136747 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d4222d954e09fb211b132d5fc953a1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"35d4222d954e09fb211b132d5fc953a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.136829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.136785 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d40ac0b32353563b61c22e4118001d86-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"d40ac0b32353563b61c22e4118001d86\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.136829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.136793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d40ac0b32353563b61c22e4118001d86-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"d40ac0b32353563b61c22e4118001d86\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.136991 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.136844 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d40ac0b32353563b61c22e4118001d86-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"d40ac0b32353563b61c22e4118001d86\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.237374 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.237337 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:36.237478 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.237380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d4222d954e09fb211b132d5fc953a1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"35d4222d954e09fb211b132d5fc953a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.237478 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.237417 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d4222d954e09fb211b132d5fc953a1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"35d4222d954e09fb211b132d5fc953a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.338159 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.338074 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:36.367265 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.367233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.372419 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:36.372077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 10 17:39:36.438782 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:36.438742 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:37.597075 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:37.597042 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:37.697465 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:37.697401 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Sep 10 17:39:37.740968 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.740939 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:37.790414 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.790381 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Sep 10 17:39:37.802961 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.802939 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:39:37.804711 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.804696 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Sep 10 17:39:37.814874 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.814857 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:39:37.836009 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.835987 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 17:39:37.836148 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.836127 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:39:37.836184 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.836159 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:39:37.872501 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.872316 2580 apiserver.go:52] "Watching apiserver" Sep 10 17:39:37.888873 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.888849 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 17:39:37.889212 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.889178 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-v4hr6","openshift-network-diagnostics/network-check-target-jtmbm","openshift-network-operator/iptables-alerter-b5dzh","kube-system/global-pull-secret-syncer-qpkj2","kube-system/konnectivity-agent-dh5km","openshift-dns/node-resolver-6lqnv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal","openshift-multus/network-metrics-daemon-dkfgm","openshift-ovn-kubernetes/ovnkube-node-kq25t","kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct","openshift-cluster-node-tuning-operator/tuned-2qjm5","openshift-image-registry/node-ca-pxk7s","openshift-multus/multus-additional-cni-plugins-bv6sf"] Sep 10 17:39:37.890342 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.890321 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 17:39:37.891570 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.891551 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.894228 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.894209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:37.894340 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:37.894290 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:37.896725 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.896708 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 17:39:37.896846 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.896726 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 17:39:37.896846 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.896728 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 17:39:37.896846 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.896837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:37.897558 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.897542 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4zdl9\"" Sep 10 17:39:37.898832 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-system-cni-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.898927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-k8s-cni-cncf-io\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.898927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-cni-multus\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.898927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-conf-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.898927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-multus-certs\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.898927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-socket-dir-parent\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.898927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-netns\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-kubelet\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-hostroot\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.898981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-etc-kubernetes\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjmq\" (UniqueName: \"kubernetes.io/projected/26099850-2bd9-422c-a702-4e195b9b5db1-kube-api-access-tzjmq\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-cnibin\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899050 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26099850-2bd9-422c-a702-4e195b9b5db1-cni-binary-copy\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-cni-bin\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-cni-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26099850-2bd9-422c-a702-4e195b9b5db1-multus-daemon-config\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.899673 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899435 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 17:39:37.899726 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899710 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 17:39:37.899726 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899720 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:39:37.899835 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899731 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8kh2s\"" Sep 10 17:39:37.899894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.899886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:37.899979 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:37.899955 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:37.900079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.900011 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 17:39:37.902096 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.902077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:37.902388 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.902372 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:39:37.903731 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.903716 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 17:39:37.903945 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.903915 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kft6h\"" Sep 10 17:39:37.904730 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.904717 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:37.904882 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.904867 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 17:39:37.907413 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.907391 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9r6zz\"" Sep 10 17:39:37.907541 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.907416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:37.907598 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:37.907551 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:37.907704 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.907691 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 17:39:37.907998 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.907984 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 17:39:37.910584 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.910568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:37.913318 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.913296 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:37.913982 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.913963 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 17:39:37.914066 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.914015 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 17:39:37.915656 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.915630 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:37.916338 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.916318 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 17:39:37.916479 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.916462 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 17:39:37.916635 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.916545 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 17:39:37.916635 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.916627 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 17:39:37.916908 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.916890 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 17:39:37.916991 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.916893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 17:39:37.917086 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.917059 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5v8n\"" Sep 10 17:39:37.917086 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.917063 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vh96r\"" Sep 10 17:39:37.918319 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.918300 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:37.918856 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.918837 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 17:39:37.918947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.918918 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j59cz\"" Sep 10 17:39:37.920585 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.920079 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:39:37.920585 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.920274 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 17:39:37.920855 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.920800 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 17:39:37.921132 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.921114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:37.921325 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.921289 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 17:39:37.922793 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.922250 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rv5zr\"" Sep 10 17:39:37.922793 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.922743 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 17:39:37.929521 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.929498 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 17:39:37.929595 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.929530 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 17:39:37.929642 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.929501 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xdph4\"" Sep 10 17:39:37.937787 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.937723 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 17:34:36 +0000 UTC" deadline="2028-03-17 13:18:51.531799201 +0000 UTC" Sep 10 17:39:37.937888 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.937787 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13291h39m13.594016007s" Sep 10 17:39:37.955451 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.955425 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-725gc" Sep 10 17:39:37.973488 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.973464 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-725gc" Sep 10 17:39:37.992056 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.992038 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 17:39:37.999482 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-lib-modules\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:37.999585 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-tmp\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:37.999585 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-cnibin\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.999585 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-cni-bin\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.999723 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999598 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-cnibin\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.999723 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:37.999723 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999674 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-cni-bin\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:37.999845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-socket-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:37.999845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-systemd\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:37.999845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/113753c6-2d59-4206-a1f1-e16e2a56d33a-dbus\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:37.999845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999789 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvj6q\" (UniqueName: \"kubernetes.io/projected/52a3092a-02fa-4419-bbd1-23e9045afcba-kube-api-access-vvj6q\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:37.999845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5bmz\" (UniqueName: \"kubernetes.io/projected/e443e321-aea0-4c13-8bf7-4eb60d3ff024-kube-api-access-m5bmz\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:37.999845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jmx9\" (UniqueName: \"kubernetes.io/projected/80722620-c40f-4ad9-87ce-60d04131eb54-kube-api-access-7jmx9\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksmxv\" (UniqueName: \"kubernetes.io/projected/ef376f5e-11a3-47b5-9676-79a3128807b1-kube-api-access-ksmxv\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef-konnectivity-ca\") pod \"konnectivity-agent-dh5km\" (UID: \"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef\") " pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-registration-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-system-cni-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:37.999989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-conf-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-slash\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-run-netns\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000042 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-conf-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80722620-c40f-4ad9-87ce-60d04131eb54-ovn-node-metrics-cert\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.000079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5l87\" (UniqueName: \"kubernetes.io/projected/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-kube-api-access-k5l87\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-cnibin\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000078 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-system-cni-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-netns\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-netns\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-etc-kubernetes\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjmq\" (UniqueName: \"kubernetes.io/projected/26099850-2bd9-422c-a702-4e195b9b5db1-kube-api-access-tzjmq\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-cni-bin\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-tuned\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26099850-2bd9-422c-a702-4e195b9b5db1-cni-binary-copy\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000255 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-etc-kubernetes\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysconfig\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-host\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000358 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e443e321-aea0-4c13-8bf7-4eb60d3ff024-host\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aadddf2-d68f-49fb-b770-5cd319c1b86e-iptables-alerter-script\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.000481 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cckmw\" (UniqueName: \"kubernetes.io/projected/4aadddf2-d68f-49fb-b770-5cd319c1b86e-kube-api-access-cckmw\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-etc-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-system-cni-dir\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-k8s-cni-cncf-io\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-multus-certs\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000575 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-k8s-cni-cncf-io\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-systemd-units\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000617 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-run-multus-certs\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3092a-02fa-4419-bbd1-23e9045afcba-tmp-dir\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aadddf2-d68f-49fb-b770-5cd319c1b86e-host-slash\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-ovn\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-run\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-var-lib-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysctl-conf\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef-agent-certs\") pod \"konnectivity-agent-dh5km\" (UID: \"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef\") " pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26099850-2bd9-422c-a702-4e195b9b5db1-multus-daemon-config\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-ovnkube-config\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000948 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52a3092a-02fa-4419-bbd1-23e9045afcba-hosts-file\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000972 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.000994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-modprobe-d\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysctl-d\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-cni-multus\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-log-socket\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-cni-netd\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001117 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-cni-multus\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-sys\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e443e321-aea0-4c13-8bf7-4eb60d3ff024-serviceca\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-env-overrides\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.001755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-sys-fs\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-kubernetes\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mx6r\" (UniqueName: \"kubernetes.io/projected/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-kube-api-access-8mx6r\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxb2\" (UniqueName: \"kubernetes.io/projected/fd07c282-9396-45a4-b27a-284f438672b6-kube-api-access-mtxb2\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-node-log\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/113753c6-2d59-4206-a1f1-e16e2a56d33a-kubelet-config\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-cni-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-run-ovn-kubernetes\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-ovnkube-script-lib\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001480 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26099850-2bd9-422c-a702-4e195b9b5db1-multus-daemon-config\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-var-lib-kubelet\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-socket-dir-parent\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-kubelet\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001448 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26099850-2bd9-422c-a702-4e195b9b5db1-cni-binary-copy\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001589 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-cni-dir\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-multus-socket-dir-parent\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-hostroot\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-kubelet\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.002748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-systemd\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.002748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-device-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.002748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-host-var-lib-kubelet\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.002748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.001634 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26099850-2bd9-422c-a702-4e195b9b5db1-hostroot\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.020289 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.020268 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:38.029612 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.029519 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 17:39:38.033614 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.033570 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjmq\" (UniqueName: \"kubernetes.io/projected/26099850-2bd9-422c-a702-4e195b9b5db1-kube-api-access-tzjmq\") pod \"multus-v4hr6\" (UID: \"26099850-2bd9-422c-a702-4e195b9b5db1\") " pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.048683 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.048648 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40ac0b32353563b61c22e4118001d86.slice/crio-9a6e5b52f63eee9472d34e059d691ab02ef44e325d8df746a740d15c98262e74 WatchSource:0}: Error finding container 9a6e5b52f63eee9472d34e059d691ab02ef44e325d8df746a740d15c98262e74: Status 404 returned error can't find the container with id 9a6e5b52f63eee9472d34e059d691ab02ef44e325d8df746a740d15c98262e74 Sep 10 17:39:38.049114 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.049095 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d4222d954e09fb211b132d5fc953a1.slice/crio-86670b54a58c57c4102672776d4baf0c80068ce025eab7bdba3fd308984eedc1 WatchSource:0}: Error finding container 86670b54a58c57c4102672776d4baf0c80068ce025eab7bdba3fd308984eedc1: Status 404 returned error can't find the container with id 86670b54a58c57c4102672776d4baf0c80068ce025eab7bdba3fd308984eedc1 Sep 10 17:39:38.053504 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.053489 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:39:38.102406 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e443e321-aea0-4c13-8bf7-4eb60d3ff024-host\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.102406 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aadddf2-d68f-49fb-b770-5cd319c1b86e-iptables-alerter-script\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cckmw\" (UniqueName: \"kubernetes.io/projected/4aadddf2-d68f-49fb-b770-5cd319c1b86e-kube-api-access-cckmw\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102466 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-etc-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-system-cni-dir\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-systemd-units\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102577 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e443e321-aea0-4c13-8bf7-4eb60d3ff024-host\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3092a-02fa-4419-bbd1-23e9045afcba-tmp-dir\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.102658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aadddf2-d68f-49fb-b770-5cd319c1b86e-host-slash\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-ovn\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-run\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.102932 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3092a-02fa-4419-bbd1-23e9045afcba-tmp-dir\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-ovn\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103088 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aadddf2-d68f-49fb-b770-5cd319c1b86e-host-slash\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-systemd-units\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103151 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aadddf2-d68f-49fb-b770-5cd319c1b86e-iptables-alerter-script\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.103157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-run\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103177 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-etc-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-var-lib-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103235 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-system-cni-dir\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysctl-conf\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-var-lib-openvswitch\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef-agent-certs\") pod \"konnectivity-agent-dh5km\" (UID: \"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef\") " pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-ovnkube-config\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.103464 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52a3092a-02fa-4419-bbd1-23e9045afcba-hosts-file\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.103526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103519 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.103530 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:38.603511427 +0000 UTC m=+2.058097758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103590 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103601 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52a3092a-02fa-4419-bbd1-23e9045afcba-hosts-file\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-modprobe-d\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysctl-d\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103644 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-log-socket\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103652 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysctl-conf\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-log-socket\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103739 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-cni-netd\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103764 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysctl-d\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-sys\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103777 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-modprobe-d\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103802 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-sys\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e443e321-aea0-4c13-8bf7-4eb60d3ff024-serviceca\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.104144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103843 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-cni-netd\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-env-overrides\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-sys-fs\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-kubernetes\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mx6r\" (UniqueName: \"kubernetes.io/projected/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-kube-api-access-8mx6r\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.103974 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-sys-fs\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxb2\" (UniqueName: \"kubernetes.io/projected/fd07c282-9396-45a4-b27a-284f438672b6-kube-api-access-mtxb2\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-node-log\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/113753c6-2d59-4206-a1f1-e16e2a56d33a-kubelet-config\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-ovnkube-config\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-run-ovn-kubernetes\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-ovnkube-script-lib\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-run-ovn-kubernetes\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/113753c6-2d59-4206-a1f1-e16e2a56d33a-kubelet-config\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-node-log\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-var-lib-kubelet\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-kubernetes\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.104970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-kubelet\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e443e321-aea0-4c13-8bf7-4eb60d3ff024-serviceca\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-systemd\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104301 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-var-lib-kubelet\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-device-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104329 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-run-systemd\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-lib-modules\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-device-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-tmp\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-lib-modules\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104372 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-env-overrides\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104312 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-kubelet\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-socket-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-systemd\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/113753c6-2d59-4206-a1f1-e16e2a56d33a-dbus\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104576 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-socket-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.105757 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvj6q\" (UniqueName: \"kubernetes.io/projected/52a3092a-02fa-4419-bbd1-23e9045afcba-kube-api-access-vvj6q\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5bmz\" (UniqueName: \"kubernetes.io/projected/e443e321-aea0-4c13-8bf7-4eb60d3ff024-kube-api-access-m5bmz\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-systemd\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104657 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80722620-c40f-4ad9-87ce-60d04131eb54-ovnkube-script-lib\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jmx9\" (UniqueName: \"kubernetes.io/projected/80722620-c40f-4ad9-87ce-60d04131eb54-kube-api-access-7jmx9\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/113753c6-2d59-4206-a1f1-e16e2a56d33a-dbus\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksmxv\" (UniqueName: \"kubernetes.io/projected/ef376f5e-11a3-47b5-9676-79a3128807b1-kube-api-access-ksmxv\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef-konnectivity-ca\") pod \"konnectivity-agent-dh5km\" (UID: \"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef\") " pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-registration-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.104981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-slash\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-run-netns\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105024 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-registration-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80722620-c40f-4ad9-87ce-60d04131eb54-ovn-node-metrics-cert\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5l87\" (UniqueName: \"kubernetes.io/projected/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-kube-api-access-k5l87\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105089 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-slash\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.106646 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-cnibin\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-cni-bin\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-tuned\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysconfig\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-host\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.105431 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105473 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef-konnectivity-ca\") pod \"konnectivity-agent-dh5km\" (UID: \"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef\") " pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.105490 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret podName:113753c6-2d59-4206-a1f1-e16e2a56d33a nodeName:}" failed. No retries permitted until 2026-09-10 17:39:38.605468827 +0000 UTC m=+2.060055201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret") pod "global-pull-secret-syncer-qpkj2" (UID: "113753c6-2d59-4206-a1f1-e16e2a56d33a") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-run-netns\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-sysconfig\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105590 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef376f5e-11a3-47b5-9676-79a3128807b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105605 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-host\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd07c282-9396-45a4-b27a-284f438672b6-cnibin\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80722620-c40f-4ad9-87ce-60d04131eb54-host-cni-bin\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.107403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.105886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd07c282-9396-45a4-b27a-284f438672b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.107903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.106375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef-agent-certs\") pod \"konnectivity-agent-dh5km\" (UID: \"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef\") " pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:38.107903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.106640 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-tmp\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.107903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.107341 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-etc-tuned\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.107903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.107486 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80722620-c40f-4ad9-87ce-60d04131eb54-ovn-node-metrics-cert\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.128204 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.128174 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:38.128204 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.128201 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:38.128385 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.128215 2580 projected.go:196] Error preparing data for projected volume kube-api-access-c47tg for pod openshift-network-diagnostics/network-check-target-jtmbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:38.128385 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.128284 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg podName:36b697fc-53ed-429e-9a35-6146d0f975e5 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:38.628265039 +0000 UTC m=+2.082851374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c47tg" (UniqueName: "kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg") pod "network-check-target-jtmbm" (UID: "36b697fc-53ed-429e-9a35-6146d0f975e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:38.132497 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.132468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5l87\" (UniqueName: \"kubernetes.io/projected/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-kube-api-access-k5l87\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:38.132637 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.132567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvj6q\" (UniqueName: \"kubernetes.io/projected/52a3092a-02fa-4419-bbd1-23e9045afcba-kube-api-access-vvj6q\") pod \"node-resolver-6lqnv\" (UID: \"52a3092a-02fa-4419-bbd1-23e9045afcba\") " pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.132637 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.132602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cckmw\" (UniqueName: \"kubernetes.io/projected/4aadddf2-d68f-49fb-b770-5cd319c1b86e-kube-api-access-cckmw\") pod \"iptables-alerter-b5dzh\" (UID: \"4aadddf2-d68f-49fb-b770-5cd319c1b86e\") " pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.133088 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.133063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jmx9\" (UniqueName: \"kubernetes.io/projected/80722620-c40f-4ad9-87ce-60d04131eb54-kube-api-access-7jmx9\") pod \"ovnkube-node-kq25t\" (UID: \"80722620-c40f-4ad9-87ce-60d04131eb54\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.134223 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.134202 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mx6r\" (UniqueName: \"kubernetes.io/projected/b8c86361-1bef-4abe-9c26-eea4eea6bdd8-kube-api-access-8mx6r\") pod \"tuned-2qjm5\" (UID: \"b8c86361-1bef-4abe-9c26-eea4eea6bdd8\") " pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.134351 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.134331 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxb2\" (UniqueName: \"kubernetes.io/projected/fd07c282-9396-45a4-b27a-284f438672b6-kube-api-access-mtxb2\") pod \"multus-additional-cni-plugins-bv6sf\" (UID: \"fd07c282-9396-45a4-b27a-284f438672b6\") " pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.136035 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.136010 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksmxv\" (UniqueName: \"kubernetes.io/projected/ef376f5e-11a3-47b5-9676-79a3128807b1-kube-api-access-ksmxv\") pod \"aws-ebs-csi-driver-node-r8dct\" (UID: \"ef376f5e-11a3-47b5-9676-79a3128807b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.137031 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.137011 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5bmz\" (UniqueName: \"kubernetes.io/projected/e443e321-aea0-4c13-8bf7-4eb60d3ff024-kube-api-access-m5bmz\") pod \"node-ca-pxk7s\" (UID: \"e443e321-aea0-4c13-8bf7-4eb60d3ff024\") " pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.234983 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.234886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4hr6" Sep 10 17:39:38.241469 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.241450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b5dzh" Sep 10 17:39:38.245018 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.244995 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26099850_2bd9_422c_a702_4e195b9b5db1.slice/crio-2b8962c21809189f071cd84d5f04abc617ab0b289da53c3dec56950a973a4521 WatchSource:0}: Error finding container 2b8962c21809189f071cd84d5f04abc617ab0b289da53c3dec56950a973a4521: Status 404 returned error can't find the container with id 2b8962c21809189f071cd84d5f04abc617ab0b289da53c3dec56950a973a4521 Sep 10 17:39:38.250331 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.250308 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aadddf2_d68f_49fb_b770_5cd319c1b86e.slice/crio-d73b5082b3827f8c94fb23e779d06b03cf8399fb5d475f38f6913f719470a359 WatchSource:0}: Error finding container d73b5082b3827f8c94fb23e779d06b03cf8399fb5d475f38f6913f719470a359: Status 404 returned error can't find the container with id d73b5082b3827f8c94fb23e779d06b03cf8399fb5d475f38f6913f719470a359 Sep 10 17:39:38.261982 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.261964 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:39:38.270914 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.270889 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa08cd90_0fe3_4cd3_a9b7_08436f5b51ef.slice/crio-2fa4e9491ab76e6e56862355935ba1c66fd9f898836754acb039706ed8318d98 WatchSource:0}: Error finding container 2fa4e9491ab76e6e56862355935ba1c66fd9f898836754acb039706ed8318d98: Status 404 returned error can't find the container with id 2fa4e9491ab76e6e56862355935ba1c66fd9f898836754acb039706ed8318d98 Sep 10 17:39:38.278058 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.278042 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lqnv" Sep 10 17:39:38.283918 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.283895 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:39:38.285692 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.285673 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a3092a_02fa_4419_bbd1_23e9045afcba.slice/crio-c447e97b73fd7a7de99e14792ffd04d0969009232f71f243bf921347190ab9b2 WatchSource:0}: Error finding container c447e97b73fd7a7de99e14792ffd04d0969009232f71f243bf921347190ab9b2: Status 404 returned error can't find the container with id c447e97b73fd7a7de99e14792ffd04d0969009232f71f243bf921347190ab9b2 Sep 10 17:39:38.293151 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.293128 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80722620_c40f_4ad9_87ce_60d04131eb54.slice/crio-7b7f048e08cd3a3047e9afea754ba2e5a97f15f77aaefea423ed544fdb9dbf6a WatchSource:0}: Error finding container 7b7f048e08cd3a3047e9afea754ba2e5a97f15f77aaefea423ed544fdb9dbf6a: Status 404 returned error can't find the container with id 7b7f048e08cd3a3047e9afea754ba2e5a97f15f77aaefea423ed544fdb9dbf6a Sep 10 17:39:38.310929 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.310908 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" Sep 10 17:39:38.313993 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.313978 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:38.319213 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.319192 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef376f5e_11a3_47b5_9676_79a3128807b1.slice/crio-0a6693600141aa4f2e6e6d5a97a60b6fadd3ed80b92736b444c869c29b79652b WatchSource:0}: Error finding container 0a6693600141aa4f2e6e6d5a97a60b6fadd3ed80b92736b444c869c29b79652b: Status 404 returned error can't find the container with id 0a6693600141aa4f2e6e6d5a97a60b6fadd3ed80b92736b444c869c29b79652b Sep 10 17:39:38.328565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.328547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" Sep 10 17:39:38.337095 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.337068 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c86361_1bef_4abe_9c26_eea4eea6bdd8.slice/crio-09e23129e7fdebb16494979a5a5a3f2f96b0bf279903c4ef65484f9ab503a071 WatchSource:0}: Error finding container 09e23129e7fdebb16494979a5a5a3f2f96b0bf279903c4ef65484f9ab503a071: Status 404 returned error can't find the container with id 09e23129e7fdebb16494979a5a5a3f2f96b0bf279903c4ef65484f9ab503a071 Sep 10 17:39:38.344398 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.344380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pxk7s" Sep 10 17:39:38.352513 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.352491 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode443e321_aea0_4c13_8bf7_4eb60d3ff024.slice/crio-7242ca1811ac3b8d64ecb488984ccf00b8998093a18acb932c8f4c447820240c WatchSource:0}: Error finding container 7242ca1811ac3b8d64ecb488984ccf00b8998093a18acb932c8f4c447820240c: Status 404 returned error can't find the container with id 7242ca1811ac3b8d64ecb488984ccf00b8998093a18acb932c8f4c447820240c Sep 10 17:39:38.355640 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.355618 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" Sep 10 17:39:38.366458 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:39:38.366423 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd07c282_9396_45a4_b27a_284f438672b6.slice/crio-5215f1ce0b07a70078c3dd47cad40bf83921455526a5049c506b8cddbac4dafd WatchSource:0}: Error finding container 5215f1ce0b07a70078c3dd47cad40bf83921455526a5049c506b8cddbac4dafd: Status 404 returned error can't find the container with id 5215f1ce0b07a70078c3dd47cad40bf83921455526a5049c506b8cddbac4dafd Sep 10 17:39:38.608703 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.608606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.608703 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.608671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:38.608946 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.608792 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:38.608946 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.608847 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:38.608946 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.608902 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret podName:113753c6-2d59-4206-a1f1-e16e2a56d33a nodeName:}" failed. No retries permitted until 2026-09-10 17:39:39.608866762 +0000 UTC m=+3.063453099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret") pod "global-pull-secret-syncer-qpkj2" (UID: "113753c6-2d59-4206-a1f1-e16e2a56d33a") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:38.608946 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.608923 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:39.608913493 +0000 UTC m=+3.063499807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:38.709391 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.709335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:38.709693 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.709676 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:38.709785 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.709698 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:38.709785 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.709708 2580 projected.go:196] Error preparing data for projected volume kube-api-access-c47tg for pod openshift-network-diagnostics/network-check-target-jtmbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:38.709785 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.709753 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg podName:36b697fc-53ed-429e-9a35-6146d0f975e5 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:39.709740161 +0000 UTC m=+3.164326474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c47tg" (UniqueName: "kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg") pod "network-check-target-jtmbm" (UID: "36b697fc-53ed-429e-9a35-6146d0f975e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:38.976059 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.975905 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:34:37 +0000 UTC" deadline="2028-03-20 23:57:05.53682335 +0000 UTC" Sep 10 17:39:38.976059 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.975948 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13374h17m26.560880993s" Sep 10 17:39:38.989971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:38.989942 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:38.990129 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:38.990083 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:39.018417 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.018353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerStarted","Data":"5215f1ce0b07a70078c3dd47cad40bf83921455526a5049c506b8cddbac4dafd"} Sep 10 17:39:39.028950 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.028913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pxk7s" event={"ID":"e443e321-aea0-4c13-8bf7-4eb60d3ff024","Type":"ContainerStarted","Data":"7242ca1811ac3b8d64ecb488984ccf00b8998093a18acb932c8f4c447820240c"} Sep 10 17:39:39.041360 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.041314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" event={"ID":"b8c86361-1bef-4abe-9c26-eea4eea6bdd8","Type":"ContainerStarted","Data":"09e23129e7fdebb16494979a5a5a3f2f96b0bf279903c4ef65484f9ab503a071"} Sep 10 17:39:39.048420 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.048383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" event={"ID":"ef376f5e-11a3-47b5-9676-79a3128807b1","Type":"ContainerStarted","Data":"0a6693600141aa4f2e6e6d5a97a60b6fadd3ed80b92736b444c869c29b79652b"} Sep 10 17:39:39.051672 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.051642 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"7b7f048e08cd3a3047e9afea754ba2e5a97f15f77aaefea423ed544fdb9dbf6a"} Sep 10 17:39:39.074764 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.074727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4hr6" event={"ID":"26099850-2bd9-422c-a702-4e195b9b5db1","Type":"ContainerStarted","Data":"2b8962c21809189f071cd84d5f04abc617ab0b289da53c3dec56950a973a4521"} Sep 10 17:39:39.086899 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.086811 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"d40ac0b32353563b61c22e4118001d86","Type":"ContainerStarted","Data":"9a6e5b52f63eee9472d34e059d691ab02ef44e325d8df746a740d15c98262e74"} Sep 10 17:39:39.100018 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.099979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" event={"ID":"35d4222d954e09fb211b132d5fc953a1","Type":"ContainerStarted","Data":"86670b54a58c57c4102672776d4baf0c80068ce025eab7bdba3fd308984eedc1"} Sep 10 17:39:39.118564 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.116292 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lqnv" event={"ID":"52a3092a-02fa-4419-bbd1-23e9045afcba","Type":"ContainerStarted","Data":"c447e97b73fd7a7de99e14792ffd04d0969009232f71f243bf921347190ab9b2"} Sep 10 17:39:39.123322 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.123286 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dh5km" event={"ID":"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef","Type":"ContainerStarted","Data":"2fa4e9491ab76e6e56862355935ba1c66fd9f898836754acb039706ed8318d98"} Sep 10 17:39:39.136225 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.136160 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b5dzh" event={"ID":"4aadddf2-d68f-49fb-b770-5cd319c1b86e","Type":"ContainerStarted","Data":"d73b5082b3827f8c94fb23e779d06b03cf8399fb5d475f38f6913f719470a359"} Sep 10 17:39:39.280170 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.280085 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:39.619473 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.619126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:39.619473 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.619199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:39.619473 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.619299 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:39.619473 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.619332 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:39.619473 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.619376 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret podName:113753c6-2d59-4206-a1f1-e16e2a56d33a nodeName:}" failed. No retries permitted until 2026-09-10 17:39:41.619356179 +0000 UTC m=+5.073942506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret") pod "global-pull-secret-syncer-qpkj2" (UID: "113753c6-2d59-4206-a1f1-e16e2a56d33a") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:39.619473 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.619397 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:41.619387108 +0000 UTC m=+5.073973421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:39.719867 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.719831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:39.720077 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.720052 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:39.720248 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.720085 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:39.720248 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.720098 2580 projected.go:196] Error preparing data for projected volume kube-api-access-c47tg for pod openshift-network-diagnostics/network-check-target-jtmbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:39.720248 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.720161 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg podName:36b697fc-53ed-429e-9a35-6146d0f975e5 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:41.72014056 +0000 UTC m=+5.174726887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c47tg" (UniqueName: "kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg") pod "network-check-target-jtmbm" (UID: "36b697fc-53ed-429e-9a35-6146d0f975e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:39.733634 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.733595 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:39.976681 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.976554 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:34:37 +0000 UTC" deadline="2028-02-04 06:11:43.957807957 +0000 UTC" Sep 10 17:39:39.976681 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.976612 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12276h32m3.981199374s" Sep 10 17:39:39.989228 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.989200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:39.989390 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.989357 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:39.989775 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:39.989755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:39.989898 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:39.989868 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:40.989303 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:40.989273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:40.989754 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:40.989480 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:41.638938 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:41.638898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:41.639121 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:41.638959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:41.639121 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.639093 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:41.639237 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.639157 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:45.639138533 +0000 UTC m=+9.093724882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:41.639753 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.639605 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:41.639753 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.639672 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret podName:113753c6-2d59-4206-a1f1-e16e2a56d33a nodeName:}" failed. No retries permitted until 2026-09-10 17:39:45.639653926 +0000 UTC m=+9.094240252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret") pod "global-pull-secret-syncer-qpkj2" (UID: "113753c6-2d59-4206-a1f1-e16e2a56d33a") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:41.739398 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:41.739359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:41.739580 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.739543 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:41.739580 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.739561 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:41.739580 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.739573 2580 projected.go:196] Error preparing data for projected volume kube-api-access-c47tg for pod openshift-network-diagnostics/network-check-target-jtmbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:41.739737 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.739621 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg podName:36b697fc-53ed-429e-9a35-6146d0f975e5 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:45.739604846 +0000 UTC m=+9.194191159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c47tg" (UniqueName: "kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg") pod "network-check-target-jtmbm" (UID: "36b697fc-53ed-429e-9a35-6146d0f975e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:41.989012 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:41.988974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:41.989213 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:41.988989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:41.989213 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.989120 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:41.989213 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:41.989186 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:42.988741 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:42.988686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:42.988958 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:42.988839 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:43.989105 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:43.989059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:43.989105 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:43.989081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:43.989775 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:43.989198 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:43.989775 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:43.989344 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:44.989138 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:44.989101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:44.989583 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:44.989236 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:45.673605 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:45.672852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:45.673605 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:45.672912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:45.673605 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.673077 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:45.673605 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.673140 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:53.673119333 +0000 UTC m=+17.127705649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:45.673605 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.673523 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:45.673605 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.673571 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret podName:113753c6-2d59-4206-a1f1-e16e2a56d33a nodeName:}" failed. No retries permitted until 2026-09-10 17:39:53.673556687 +0000 UTC m=+17.128143024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret") pod "global-pull-secret-syncer-qpkj2" (UID: "113753c6-2d59-4206-a1f1-e16e2a56d33a") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:45.774552 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:45.773970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:45.774552 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.774131 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:45.774552 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.774150 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:45.774552 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.774163 2580 projected.go:196] Error preparing data for projected volume kube-api-access-c47tg for pod openshift-network-diagnostics/network-check-target-jtmbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:45.774552 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.774222 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg podName:36b697fc-53ed-429e-9a35-6146d0f975e5 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:53.774203885 +0000 UTC m=+17.228790201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c47tg" (UniqueName: "kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg") pod "network-check-target-jtmbm" (UID: "36b697fc-53ed-429e-9a35-6146d0f975e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:45.988647 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:45.988568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:45.988829 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.988705 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:45.988829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:45.988568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:45.988934 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:45.988834 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:46.990854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:46.990372 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:46.990854 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:46.990483 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:47.988806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:47.988771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:47.988964 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:47.988771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:47.988964 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:47.988924 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:47.989077 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:47.989028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:48.989571 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:48.989525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:48.990062 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:48.989639 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:49.989276 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:49.989238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:49.989441 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:49.989260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:49.989441 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:49.989375 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:49.989557 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:49.989475 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:50.989524 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:50.989490 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:50.990030 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:50.989623 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:51.989021 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:51.988992 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:51.989021 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:51.989023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:51.989213 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:51.989106 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:51.989249 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:51.989214 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:52.989296 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:52.989209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:52.992263 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:52.989917 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:53.736119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:53.736078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:53.736350 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:53.736141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:53.736350 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.736201 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:53.736350 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.736252 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:53.736350 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.736272 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret podName:113753c6-2d59-4206-a1f1-e16e2a56d33a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:09.736256028 +0000 UTC m=+33.190842359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret") pod "global-pull-secret-syncer-qpkj2" (UID: "113753c6-2d59-4206-a1f1-e16e2a56d33a") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:53.736350 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.736300 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:09.736283251 +0000 UTC m=+33.190869566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:53.836766 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:53.836734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:53.836958 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.836922 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:53.836958 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.836944 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:53.836958 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.836954 2580 projected.go:196] Error preparing data for projected volume kube-api-access-c47tg for pod openshift-network-diagnostics/network-check-target-jtmbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:53.837148 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.837015 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg podName:36b697fc-53ed-429e-9a35-6146d0f975e5 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:09.836997444 +0000 UTC m=+33.291583757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c47tg" (UniqueName: "kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg") pod "network-check-target-jtmbm" (UID: "36b697fc-53ed-429e-9a35-6146d0f975e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:53.989109 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:53.989017 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:53.989109 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:53.989053 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:53.989314 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.989163 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:53.989314 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:53.989272 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:54.989606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:54.989570 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:54.990080 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:54.989751 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:55.988912 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:55.988874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:55.989092 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:55.988881 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:55.989092 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:55.989013 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:55.989186 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:55.989123 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:56.990048 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:56.990024 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:56.990464 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:56.990114 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:57.178370 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.178335 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" event={"ID":"b8c86361-1bef-4abe-9c26-eea4eea6bdd8","Type":"ContainerStarted","Data":"9b66aa4dd4cd1dafd2b9561b839d8be01a720d12fc15ac9f7c1dff437b5b923f"} Sep 10 17:39:57.183960 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.183931 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:39:57.185431 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.185270 2580 generic.go:356] "Generic (PLEG): container finished" podID="80722620-c40f-4ad9-87ce-60d04131eb54" containerID="2f692bcfc89d961e6e5851d0122536da12295ef0e2dcb2a4e6657c5b0ff3436c" exitCode=1 Sep 10 17:39:57.185431 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.185367 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerDied","Data":"2f692bcfc89d961e6e5851d0122536da12295ef0e2dcb2a4e6657c5b0ff3436c"} Sep 10 17:39:57.185560 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.185453 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"2814990e9c80627dd2d4fb7f6474751db4f49479bafaba1994628b71910ed2b9"} Sep 10 17:39:57.187845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.187783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4hr6" event={"ID":"26099850-2bd9-422c-a702-4e195b9b5db1","Type":"ContainerStarted","Data":"43ccfa3004f4f7dc09c514582682b542224f9751f2fcb44009d6582047cfcf9b"} Sep 10 17:39:57.203003 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.202649 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2qjm5" podStartSLOduration=1.79942629 podStartE2EDuration="20.202627167s" totalImagesPullingTime="18.403200877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:57.202255765 +0000 UTC m=+20.656842101" watchObservedRunningTime="2026-09-10 17:39:57.202627167 +0000 UTC m=+20.657213503" Sep 10 17:39:57.205518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.205493 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" event={"ID":"35d4222d954e09fb211b132d5fc953a1","Type":"ContainerStarted","Data":"341e592471756fec47c13c5cb8e1e09bb38b0899a66757d7b9767cc70f3e225e"} Sep 10 17:39:57.226573 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.226515 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v4hr6" podStartSLOduration=1.6967070359999998 podStartE2EDuration="20.226498768s" totalImagesPullingTime="18.529791732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:57.226265929 +0000 UTC m=+20.680852270" watchObservedRunningTime="2026-09-10 17:39:57.226498768 +0000 UTC m=+20.681085103" Sep 10 17:39:57.244287 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.244228 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" podStartSLOduration=20.244206314 podStartE2EDuration="20.244206314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:57.243804477 +0000 UTC m=+20.698390812" watchObservedRunningTime="2026-09-10 17:39:57.244206314 +0000 UTC m=+20.698792651" Sep 10 17:39:57.988730 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.988703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:57.988921 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:57.988697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:57.988921 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:57.988834 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:39:57.988921 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:57.988903 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:58.209946 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.209883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dh5km" event={"ID":"fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef","Type":"ContainerStarted","Data":"a938a55364743aa8de33538e2702816725e89cfae584fe6b93986d8a1941556f"} Sep 10 17:39:58.211538 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.211497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b5dzh" event={"ID":"4aadddf2-d68f-49fb-b770-5cd319c1b86e","Type":"ContainerStarted","Data":"1131dae22a61bed48fb4fad3394145b8c3f488136f46ce45b92b47d9f0b83744"} Sep 10 17:39:58.213136 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.213111 2580 generic.go:356] "Generic (PLEG): container finished" podID="fd07c282-9396-45a4-b27a-284f438672b6" containerID="e1e838f328c7c758a854cff7f5a0b09a87e49f0eed963ff8f41e0933c8ba66b9" exitCode=0 Sep 10 17:39:58.213219 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.213190 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerDied","Data":"e1e838f328c7c758a854cff7f5a0b09a87e49f0eed963ff8f41e0933c8ba66b9"} Sep 10 17:39:58.215018 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.214999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pxk7s" event={"ID":"e443e321-aea0-4c13-8bf7-4eb60d3ff024","Type":"ContainerStarted","Data":"73b9216d0dcaa1352b74420b58ca151fdc673d22dba91085642b342c26395c1c"} Sep 10 17:39:58.216622 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.216601 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" event={"ID":"ef376f5e-11a3-47b5-9676-79a3128807b1","Type":"ContainerStarted","Data":"f93190fa39add84fbf33cc57ff3d1073f0cae418f934ef54f0ffdb0e9e489b80"} Sep 10 17:39:58.219649 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.219623 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:39:58.220071 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.220046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"26ffeabc1c4138a23d4a6bb5af15309e6650be831caf4cc46013ba73e00202d9"} Sep 10 17:39:58.220168 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.220122 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"27d8877792cdc12554a3899c125a1eab6845050697c2e54883306db25ef0d223"} Sep 10 17:39:58.220257 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.220171 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"dd4edd47ccbc488b5073d130beef478a0beba54f86a6029da742e46915749756"} Sep 10 17:39:58.220257 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.220216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"dfe762da3d1c52db7f90b87a4631c666202109c58619de1d1aa124e231e88e38"} Sep 10 17:39:58.221656 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.221636 2580 generic.go:356] "Generic (PLEG): container finished" podID="d40ac0b32353563b61c22e4118001d86" containerID="90cc1e948fb1046a4af4df4d63bb9a1de976afee6f932d6a7218c45587258089" exitCode=0 Sep 10 17:39:58.221730 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.221694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"d40ac0b32353563b61c22e4118001d86","Type":"ContainerDied","Data":"90cc1e948fb1046a4af4df4d63bb9a1de976afee6f932d6a7218c45587258089"} Sep 10 17:39:58.224285 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.224263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lqnv" event={"ID":"52a3092a-02fa-4419-bbd1-23e9045afcba","Type":"ContainerStarted","Data":"a64dcd066c5e90b3dd5014539a28cabf8a6cf736c312e829f4569e756a808256"} Sep 10 17:39:58.227412 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.227376 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dh5km" podStartSLOduration=2.757684922 podStartE2EDuration="21.227364638s" totalImagesPullingTime="18.469679716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:58.227012252 +0000 UTC m=+21.681598588" watchObservedRunningTime="2026-09-10 17:39:58.227364638 +0000 UTC m=+21.681950974" Sep 10 17:39:58.244808 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.244767 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pxk7s" podStartSLOduration=2.901380281 podStartE2EDuration="21.244755518s" totalImagesPullingTime="18.343375237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:58.242964652 +0000 UTC m=+21.697550987" watchObservedRunningTime="2026-09-10 17:39:58.244755518 +0000 UTC m=+21.699341851" Sep 10 17:39:58.279510 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.279471 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b5dzh" podStartSLOduration=2.792040745 podStartE2EDuration="21.279458737s" totalImagesPullingTime="18.487417992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:58.279218801 +0000 UTC m=+21.733805134" watchObservedRunningTime="2026-09-10 17:39:58.279458737 +0000 UTC m=+21.734045070" Sep 10 17:39:58.298680 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.298657 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 17:39:58.969009 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.968903 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T17:39:58.298678008Z","UUID":"50b48410-07b6-4aa9-a610-8246ea73ea23","Handler":null,"Name":"","Endpoint":""} Sep 10 17:39:58.970980 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.970958 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 17:39:58.971138 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.970995 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 17:39:58.988639 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:58.988612 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:39:58.988759 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:58.988731 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:39:59.228805 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.228722 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" event={"ID":"ef376f5e-11a3-47b5-9676-79a3128807b1","Type":"ContainerStarted","Data":"3d91554e899d0f102f8b3668718602860a3005b269fdbc982ed202776849238f"} Sep 10 17:39:59.228805 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.228782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" event={"ID":"ef376f5e-11a3-47b5-9676-79a3128807b1","Type":"ContainerStarted","Data":"f22fa0c88a807d85b17841ef189089d5db6528d66a4410755873b6c8cfe9321b"} Sep 10 17:39:59.230689 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.230661 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"d40ac0b32353563b61c22e4118001d86","Type":"ContainerStarted","Data":"e9e0052bc566389cc58fda42c28acabaa627ad50526d8e4673d2b21741732ec5"} Sep 10 17:39:59.250063 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.250014 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6lqnv" podStartSLOduration=3.839738436 podStartE2EDuration="22.249995653s" totalImagesPullingTime="18.410257217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:58.326644588 +0000 UTC m=+21.781230924" watchObservedRunningTime="2026-09-10 17:39:59.249995653 +0000 UTC m=+22.704581989" Sep 10 17:39:59.250380 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.250351 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8dct" podStartSLOduration=2.323225568 podStartE2EDuration="22.250345163s" totalImagesPullingTime="19.927119595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:59.249769253 +0000 UTC m=+22.704355586" watchObservedRunningTime="2026-09-10 17:39:59.250345163 +0000 UTC m=+22.704931542" Sep 10 17:39:59.269324 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.269276 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" podStartSLOduration=22.269267942 podStartE2EDuration="22.269267942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:59.268948782 +0000 UTC m=+22.723535116" watchObservedRunningTime="2026-09-10 17:39:59.269267942 +0000 UTC m=+22.723854275" Sep 10 17:39:59.989455 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.989418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:39:59.989455 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:39:59.989440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:39:59.989681 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:59.989540 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:39:59.989747 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:39:59.989671 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:40:00.236700 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:00.236667 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:40:00.237717 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:00.237686 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"65e54c26e2ecb9efbbfe25c0cb8ed161d6c55c99252d7bf11b890803294ae832"} Sep 10 17:40:00.988601 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:00.988565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:00.988834 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:00.988699 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:40:01.728953 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:01.728916 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:40:01.729663 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:01.729636 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:40:01.988870 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:01.988832 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:01.988870 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:01.988872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:01.989074 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:01.988944 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:40:01.989074 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:01.989059 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:40:02.989625 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:02.989446 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:02.990093 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:02.989707 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:40:03.245944 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.245846 2580 generic.go:356] "Generic (PLEG): container finished" podID="fd07c282-9396-45a4-b27a-284f438672b6" containerID="31e120289147e217da99e3de13ce871c4221e999a55036b2a58ce4b05b4a7153" exitCode=0 Sep 10 17:40:03.245944 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.245926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerDied","Data":"31e120289147e217da99e3de13ce871c4221e999a55036b2a58ce4b05b4a7153"} Sep 10 17:40:03.252345 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.252327 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:40:03.252712 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.252691 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"905c40f1bad0917bc82274be9abed6a28f0793047aa52756f49804acc4a7b25d"} Sep 10 17:40:03.253053 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.253032 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:40:03.253145 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.253099 2580 scope.go:117] "RemoveContainer" containerID="2f692bcfc89d961e6e5851d0122536da12295ef0e2dcb2a4e6657c5b0ff3436c" Sep 10 17:40:03.267830 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.267799 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:40:03.545076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.544980 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:40:03.545246 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.545124 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 17:40:03.545731 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.545625 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dh5km" Sep 10 17:40:03.988622 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.988597 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:03.988622 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:03.988614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:03.988886 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:03.988689 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:40:03.988886 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:03.988801 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:40:04.152663 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.152637 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:40:04.256765 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.256678 2580 generic.go:356] "Generic (PLEG): container finished" podID="fd07c282-9396-45a4-b27a-284f438672b6" containerID="408fd40f1d57789ec9109a169c8eddcc7cf3dcc9abad4cffdfabc7f16a1409b7" exitCode=0 Sep 10 17:40:04.256924 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.256760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerDied","Data":"408fd40f1d57789ec9109a169c8eddcc7cf3dcc9abad4cffdfabc7f16a1409b7"} Sep 10 17:40:04.260631 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.260609 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:40:04.261069 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.261048 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" event={"ID":"80722620-c40f-4ad9-87ce-60d04131eb54","Type":"ContainerStarted","Data":"4778c2803782db4bc2d5e77a77320385812dc8271e0749f122518e7aebe9653b"} Sep 10 17:40:04.261196 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.261183 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:40:04.275590 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.275565 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:40:04.315006 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.314956 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" podStartSLOduration=8.652565838 podStartE2EDuration="27.31494325s" totalImagesPullingTime="18.662377412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:04.31438403 +0000 UTC m=+27.768970364" watchObservedRunningTime="2026-09-10 17:40:04.31494325 +0000 UTC m=+27.769529585" Sep 10 17:40:04.348753 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.348717 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qpkj2"] Sep 10 17:40:04.348931 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.348915 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:04.349065 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:04.349044 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:40:04.362761 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.362707 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtmbm"] Sep 10 17:40:04.362917 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.362842 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dkfgm"] Sep 10 17:40:04.362984 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.362949 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:04.363163 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:04.363134 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:40:04.363505 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:04.363218 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:04.363627 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:04.363591 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:40:05.265544 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:05.265459 2580 generic.go:356] "Generic (PLEG): container finished" podID="fd07c282-9396-45a4-b27a-284f438672b6" containerID="d87986db6f1cfe6912a6aab2e37e5bdd2332cd49271e99cf9493aa3166dfc810" exitCode=0 Sep 10 17:40:05.266028 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:05.265549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerDied","Data":"d87986db6f1cfe6912a6aab2e37e5bdd2332cd49271e99cf9493aa3166dfc810"} Sep 10 17:40:05.988517 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:05.988484 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:05.988517 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:05.988510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:05.988717 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:05.988521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:05.988717 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:05.988598 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:40:05.988791 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:05.988715 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:40:05.988856 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:05.988800 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:40:07.989098 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:07.989069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:07.989624 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:07.989085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:07.989624 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:07.989192 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtmbm" podUID="36b697fc-53ed-429e-9a35-6146d0f975e5" Sep 10 17:40:07.989624 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:07.989222 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpkj2" podUID="113753c6-2d59-4206-a1f1-e16e2a56d33a" Sep 10 17:40:07.989624 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:07.989270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:07.989624 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:07.989347 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkfgm" podUID="85c5df57-ce4d-4f92-92ea-ddb6735e3b59" Sep 10 17:40:09.759332 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.759248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:09.759332 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.759302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:09.759774 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.759400 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:40:09.759774 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.759418 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:40:09.759774 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.759471 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret podName:113753c6-2d59-4206-a1f1-e16e2a56d33a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:41.75945026 +0000 UTC m=+65.214036591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret") pod "global-pull-secret-syncer-qpkj2" (UID: "113753c6-2d59-4206-a1f1-e16e2a56d33a") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:40:09.759774 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.759491 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:41.759483038 +0000 UTC m=+65.214069350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:40:09.778654 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.778626 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeReady" Sep 10 17:40:09.778784 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.778767 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 17:40:09.854184 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.854076 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k2jpl"] Sep 10 17:40:09.860082 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.860051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:09.860220 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.860169 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:40:09.860220 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.860191 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:40:09.860220 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.860200 2580 projected.go:196] Error preparing data for projected volume kube-api-access-c47tg for pod openshift-network-diagnostics/network-check-target-jtmbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:40:09.860323 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:09.860252 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg podName:36b697fc-53ed-429e-9a35-6146d0f975e5 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:41.860240039 +0000 UTC m=+65.314826371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c47tg" (UniqueName: "kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg") pod "network-check-target-jtmbm" (UID: "36b697fc-53ed-429e-9a35-6146d0f975e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:40:09.881227 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.881199 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r8fsr"] Sep 10 17:40:09.881376 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.881342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:09.883282 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.883256 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 17:40:09.883528 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.883506 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 17:40:09.883642 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.883511 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dwwmp\"" Sep 10 17:40:09.907485 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.907457 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k2jpl"] Sep 10 17:40:09.907598 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.907506 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8fsr"] Sep 10 17:40:09.907598 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.907577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:09.909529 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.909508 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 17:40:09.909645 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.909550 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7xd5n\"" Sep 10 17:40:09.909902 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.909807 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 17:40:09.910011 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.909989 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 17:40:09.960847 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.960797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-config-volume\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:09.960992 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.960864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm7pg\" (UniqueName: \"kubernetes.io/projected/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-kube-api-access-rm7pg\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:09.960992 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.960906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:09.960992 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.960926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-tmp-dir\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:09.989067 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.989039 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:09.989198 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.989154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:09.989198 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.989171 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:09.991478 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.991444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d22m9\"" Sep 10 17:40:09.991478 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.991462 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:40:09.991478 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.991454 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:40:09.991700 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.991502 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:40:09.991700 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.991452 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjm6q\"" Sep 10 17:40:09.991700 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:09.991566 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:40:10.061965 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.061863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-config-volume\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.061965 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.061929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm7pg\" (UniqueName: \"kubernetes.io/projected/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-kube-api-access-rm7pg\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.062181 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.062060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.062181 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.062085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-tmp-dir\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.062181 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.062117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04acc994-5125-44f9-9285-8262cd834126-cert\") pod \"ingress-canary-r8fsr\" (UID: \"04acc994-5125-44f9-9285-8262cd834126\") " pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:10.062181 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.062159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsj89\" (UniqueName: \"kubernetes.io/projected/04acc994-5125-44f9-9285-8262cd834126-kube-api-access-hsj89\") pod \"ingress-canary-r8fsr\" (UID: \"04acc994-5125-44f9-9285-8262cd834126\") " pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:10.062372 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:10.062183 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:10.062372 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:10.062242 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:10.562222482 +0000 UTC m=+34.016808797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:40:10.062484 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.062387 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-tmp-dir\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.062570 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.062546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-config-volume\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.073569 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.073540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm7pg\" (UniqueName: \"kubernetes.io/projected/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-kube-api-access-rm7pg\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.162629 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.162575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsj89\" (UniqueName: \"kubernetes.io/projected/04acc994-5125-44f9-9285-8262cd834126-kube-api-access-hsj89\") pod \"ingress-canary-r8fsr\" (UID: \"04acc994-5125-44f9-9285-8262cd834126\") " pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:10.162809 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.162697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04acc994-5125-44f9-9285-8262cd834126-cert\") pod \"ingress-canary-r8fsr\" (UID: \"04acc994-5125-44f9-9285-8262cd834126\") " pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:10.165747 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.165719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04acc994-5125-44f9-9285-8262cd834126-cert\") pod \"ingress-canary-r8fsr\" (UID: \"04acc994-5125-44f9-9285-8262cd834126\") " pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:10.172293 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.172269 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsj89\" (UniqueName: \"kubernetes.io/projected/04acc994-5125-44f9-9285-8262cd834126-kube-api-access-hsj89\") pod \"ingress-canary-r8fsr\" (UID: \"04acc994-5125-44f9-9285-8262cd834126\") " pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:10.216319 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.216287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8fsr" Sep 10 17:40:10.566453 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.566276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:10.566599 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:10.566429 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:10.566599 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:10.566557 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:11.566542759 +0000 UTC m=+35.021129072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:40:10.759702 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:10.759632 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8fsr"] Sep 10 17:40:10.767363 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:40:10.767338 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04acc994_5125_44f9_9285_8262cd834126.slice/crio-75df6e32b6e2f7466b9584fe739443b33ce425b25cdbc999bfa2177f546b90a6 WatchSource:0}: Error finding container 75df6e32b6e2f7466b9584fe739443b33ce425b25cdbc999bfa2177f546b90a6: Status 404 returned error can't find the container with id 75df6e32b6e2f7466b9584fe739443b33ce425b25cdbc999bfa2177f546b90a6 Sep 10 17:40:11.281551 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:11.281513 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8fsr" event={"ID":"04acc994-5125-44f9-9285-8262cd834126","Type":"ContainerStarted","Data":"75df6e32b6e2f7466b9584fe739443b33ce425b25cdbc999bfa2177f546b90a6"} Sep 10 17:40:11.284979 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:11.284909 2580 generic.go:356] "Generic (PLEG): container finished" podID="fd07c282-9396-45a4-b27a-284f438672b6" containerID="1ecebb98a8749e2bd6d30ebf317d2ae90a39a037532a1356afe31c35281dde07" exitCode=0 Sep 10 17:40:11.285107 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:11.284983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerDied","Data":"1ecebb98a8749e2bd6d30ebf317d2ae90a39a037532a1356afe31c35281dde07"} Sep 10 17:40:11.574300 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:11.574213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:11.574449 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:11.574362 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:11.574449 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:11.574447 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:13.574418752 +0000 UTC m=+37.029005079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:40:12.291023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:12.290989 2580 generic.go:356] "Generic (PLEG): container finished" podID="fd07c282-9396-45a4-b27a-284f438672b6" containerID="dd6425f898721e4d8d1c8acb71c3d5ae11364eeb2d2250fc52e1c02d22213f2f" exitCode=0 Sep 10 17:40:12.291803 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:12.291047 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerDied","Data":"dd6425f898721e4d8d1c8acb71c3d5ae11364eeb2d2250fc52e1c02d22213f2f"} Sep 10 17:40:13.297928 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:13.297643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" event={"ID":"fd07c282-9396-45a4-b27a-284f438672b6","Type":"ContainerStarted","Data":"9c05ecc58bda12470304128c7c5fb31db1f29177eeb2bafac0245a79c32aa865"} Sep 10 17:40:13.299200 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:13.299178 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8fsr" event={"ID":"04acc994-5125-44f9-9285-8262cd834126","Type":"ContainerStarted","Data":"03dfae2df7eede4a4da0ed68b92e77788fb87c31f5f02203a3f35713bcb3d7d7"} Sep 10 17:40:13.319321 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:13.319266 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bv6sf" podStartSLOduration=6.67773157 podStartE2EDuration="36.319248171s" totalImagesPullingTime="29.641516601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:13.317639631 +0000 UTC m=+36.772225964" watchObservedRunningTime="2026-09-10 17:40:13.319248171 +0000 UTC m=+36.773834507" Sep 10 17:40:13.335795 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:13.335741 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r8fsr" podStartSLOduration=1.938165999 podStartE2EDuration="4.335725987s" totalImagesPullingTime="2.397559988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:13.335319497 +0000 UTC m=+36.789905833" watchObservedRunningTime="2026-09-10 17:40:13.335725987 +0000 UTC m=+36.790312321" Sep 10 17:40:13.592012 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:13.591909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:13.592141 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:13.592047 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:13.592141 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:13.592102 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:17.592088728 +0000 UTC m=+41.046675040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:40:17.620872 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:17.620804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:17.621264 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:17.620962 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:17.621264 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:17.621025 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:25.621010106 +0000 UTC m=+49.075596418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:40:25.679092 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:25.679053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:25.679617 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:25.679247 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:25.679617 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:25.679329 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:40:41.679305325 +0000 UTC m=+65.133891637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:40:36.278018 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:36.277989 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq25t" Sep 10 17:40:41.688608 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.688560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:40:41.689125 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:41.688689 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:41.689125 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:41.688744 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:41:13.688729787 +0000 UTC m=+97.143316111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:40:41.788915 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.788876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:41.788915 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.788922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:40:41.791163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.791127 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:40:41.791265 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.791180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:40:41.799779 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:41.799761 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:40:41.799882 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:40:41.799842 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs podName:85c5df57-ce4d-4f92-92ea-ddb6735e3b59 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:45.799807678 +0000 UTC m=+129.254393990 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs") pod "network-metrics-daemon-dkfgm" (UID: "85c5df57-ce4d-4f92-92ea-ddb6735e3b59") : secret "metrics-daemon-secret" not found Sep 10 17:40:41.803027 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.803005 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113753c6-2d59-4206-a1f1-e16e2a56d33a-original-pull-secret\") pod \"global-pull-secret-syncer-qpkj2\" (UID: \"113753c6-2d59-4206-a1f1-e16e2a56d33a\") " pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:41.806460 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.806438 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpkj2" Sep 10 17:40:41.890255 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.890226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:41.892945 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.892919 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:40:41.902799 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.902780 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:40:41.913459 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:41.913433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c47tg\" (UniqueName: \"kubernetes.io/projected/36b697fc-53ed-429e-9a35-6146d0f975e5-kube-api-access-c47tg\") pod \"network-check-target-jtmbm\" (UID: \"36b697fc-53ed-429e-9a35-6146d0f975e5\") " pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:42.102914 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:42.102803 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjm6q\"" Sep 10 17:40:42.105676 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:42.105652 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qpkj2"] Sep 10 17:40:42.108924 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:40:42.108900 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113753c6_2d59_4206_a1f1_e16e2a56d33a.slice/crio-b568e56d307ced6c7084fff97f0d8a99c8e840b5658242bf2a65d060e2d677a8 WatchSource:0}: Error finding container b568e56d307ced6c7084fff97f0d8a99c8e840b5658242bf2a65d060e2d677a8: Status 404 returned error can't find the container with id b568e56d307ced6c7084fff97f0d8a99c8e840b5658242bf2a65d060e2d677a8 Sep 10 17:40:42.110813 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:42.110794 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:42.366400 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:42.366327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qpkj2" event={"ID":"113753c6-2d59-4206-a1f1-e16e2a56d33a","Type":"ContainerStarted","Data":"b568e56d307ced6c7084fff97f0d8a99c8e840b5658242bf2a65d060e2d677a8"} Sep 10 17:40:42.372879 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:42.372854 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtmbm"] Sep 10 17:40:42.375755 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:40:42.375732 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b697fc_53ed_429e_9a35_6146d0f975e5.slice/crio-22ac474f08c29e6eec6703284d7c8020fa900ea1e3450dea7ba6c8405557501d WatchSource:0}: Error finding container 22ac474f08c29e6eec6703284d7c8020fa900ea1e3450dea7ba6c8405557501d: Status 404 returned error can't find the container with id 22ac474f08c29e6eec6703284d7c8020fa900ea1e3450dea7ba6c8405557501d Sep 10 17:40:43.371632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:43.371592 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtmbm" event={"ID":"36b697fc-53ed-429e-9a35-6146d0f975e5","Type":"ContainerStarted","Data":"22ac474f08c29e6eec6703284d7c8020fa900ea1e3450dea7ba6c8405557501d"} Sep 10 17:40:47.383680 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:47.383642 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qpkj2" event={"ID":"113753c6-2d59-4206-a1f1-e16e2a56d33a","Type":"ContainerStarted","Data":"98f7729d7c97021c4dbc40dbaf851e03ffc1c5220d837fed801d850b7a482e82"} Sep 10 17:40:47.385170 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:47.385145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtmbm" event={"ID":"36b697fc-53ed-429e-9a35-6146d0f975e5","Type":"ContainerStarted","Data":"891e1994c3a1181c6128ea6d21aaf8043d118704b605c47a567e7adcc0d2ce95"} Sep 10 17:40:47.385288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:47.385269 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:40:47.398550 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:47.398503 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qpkj2" podStartSLOduration=65.801643613 podStartE2EDuration="1m10.39848548s" totalImagesPullingTime="4.596841867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:47.397486838 +0000 UTC m=+70.852073171" watchObservedRunningTime="2026-09-10 17:40:47.39848548 +0000 UTC m=+70.853071815" Sep 10 17:40:47.410339 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:40:47.410301 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jtmbm" podStartSLOduration=66.083261404 podStartE2EDuration="1m10.410287771s" totalImagesPullingTime="4.327026367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:47.409844282 +0000 UTC m=+70.864430631" watchObservedRunningTime="2026-09-10 17:40:47.410287771 +0000 UTC m=+70.864874106" Sep 10 17:41:13.710578 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:13.710460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:41:13.711083 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:13.710590 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:41:13.711083 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:13.710645 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls podName:daa4ae8d-f32a-4dec-b25e-008beeddbc9a nodeName:}" failed. No retries permitted until 2026-09-10 17:42:17.710631573 +0000 UTC m=+161.165217886 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls") pod "dns-default-k2jpl" (UID: "daa4ae8d-f32a-4dec-b25e-008beeddbc9a") : secret "dns-default-metrics-tls" not found Sep 10 17:41:18.390158 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:18.390121 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jtmbm" Sep 10 17:41:21.389334 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.389300 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr"] Sep 10 17:41:21.419582 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.419547 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr"] Sep 10 17:41:21.419748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.419641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.423609 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.423588 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 17:41:21.423957 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.423944 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 17:41:21.424150 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.424138 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 17:41:21.424592 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.424573 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:41:21.424678 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.424623 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7vvv9\"" Sep 10 17:41:21.498248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.498214 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn"] Sep 10 17:41:21.519467 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.519429 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn"] Sep 10 17:41:21.519625 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.519524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" Sep 10 17:41:21.520772 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.520747 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-kmk69"] Sep 10 17:41:21.522042 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.522022 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:41:21.522836 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.522801 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 17:41:21.522929 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.522885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4hbzb\"" Sep 10 17:41:21.539564 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.539542 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bf59cb5f4-58bgz"] Sep 10 17:41:21.539705 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.539663 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:21.544243 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.544220 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zk8t4\"" Sep 10 17:41:21.544575 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.544554 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 10 17:41:21.544670 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.544582 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 10 17:41:21.561612 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.561581 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-kmk69"] Sep 10 17:41:21.561762 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.561626 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bf59cb5f4-58bgz"] Sep 10 17:41:21.561762 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.561718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.563479 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.563459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f52e1c-c3d1-4215-819b-e4f7527811e6-serving-cert\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.563566 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.563513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f52e1c-c3d1-4215-819b-e4f7527811e6-config\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.563566 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.563536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnc69\" (UniqueName: \"kubernetes.io/projected/b4f52e1c-c3d1-4215-819b-e4f7527811e6-kube-api-access-mnc69\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.563733 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.563716 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 17:41:21.563915 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.563895 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 17:41:21.564038 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.563923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 17:41:21.564038 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.563923 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-scp2l\"" Sep 10 17:41:21.564038 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.564030 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 17:41:21.564221 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.564118 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 17:41:21.564312 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.564293 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 17:41:21.664850 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.664728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f52e1c-c3d1-4215-819b-e4f7527811e6-config\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.664850 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.664764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnc69\" (UniqueName: \"kubernetes.io/projected/b4f52e1c-c3d1-4215-819b-e4f7527811e6-kube-api-access-mnc69\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.664850 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.664792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.665134 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.664858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-stats-auth\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.665134 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.664916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktcfq\" (UniqueName: \"kubernetes.io/projected/afaf70a3-9531-4097-b4ff-bdd880fe0a81-kube-api-access-ktcfq\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.665134 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.664958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:21.665134 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.664992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f52e1c-c3d1-4215-819b-e4f7527811e6-serving-cert\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.665134 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.665013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9854j\" (UniqueName: \"kubernetes.io/projected/d86f8b3e-b713-40fd-bfa4-758114583bff-kube-api-access-9854j\") pod \"volume-data-source-validator-695c895bd6-prxhn\" (UID: \"d86f8b3e-b713-40fd-bfa4-758114583bff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" Sep 10 17:41:21.665134 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.665038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-default-certificate\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.665134 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.665123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d904b533-dca6-4546-a1a3-4e85c1caff35-nginx-conf\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:21.665528 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.665178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.665528 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.665434 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f52e1c-c3d1-4215-819b-e4f7527811e6-config\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.667210 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.667192 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f52e1c-c3d1-4215-819b-e4f7527811e6-serving-cert\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.676300 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.676276 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnc69\" (UniqueName: \"kubernetes.io/projected/b4f52e1c-c3d1-4215-819b-e4f7527811e6-kube-api-access-mnc69\") pod \"service-ca-operator-859f94c4b-9gwnr\" (UID: \"b4f52e1c-c3d1-4215-819b-e4f7527811e6\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.697192 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.697161 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-fd99q"] Sep 10 17:41:21.721428 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.721398 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-7rpps"] Sep 10 17:41:21.721566 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.721531 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" Sep 10 17:41:21.724059 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.724034 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2m2pc\"" Sep 10 17:41:21.727593 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.727572 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" Sep 10 17:41:21.740440 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.740411 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-fd99q"] Sep 10 17:41:21.740577 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.740453 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-7rpps"] Sep 10 17:41:21.740577 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.740528 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.742827 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.742793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-whvj5\"" Sep 10 17:41:21.742947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.742793 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 17:41:21.743012 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.742985 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 17:41:21.743130 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.743113 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 17:41:21.743202 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.743180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 17:41:21.749613 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.749593 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 17:41:21.766240 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d904b533-dca6-4546-a1a3-4e85c1caff35-nginx-conf\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:21.766373 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.766373 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.766373 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-stats-auth\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.766537 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcfq\" (UniqueName: \"kubernetes.io/projected/afaf70a3-9531-4097-b4ff-bdd880fe0a81-kube-api-access-ktcfq\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.766537 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:21.766537 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9854j\" (UniqueName: \"kubernetes.io/projected/d86f8b3e-b713-40fd-bfa4-758114583bff-kube-api-access-9854j\") pod \"volume-data-source-validator-695c895bd6-prxhn\" (UID: \"d86f8b3e-b713-40fd-bfa4-758114583bff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" Sep 10 17:41:21.766537 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.766474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-default-certificate\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.766537 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:21.766480 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:41:21.766537 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:21.766487 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:22.266468088 +0000 UTC m=+105.721054418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : configmap references non-existent config key: service-ca.crt Sep 10 17:41:21.766842 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:21.766557 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:22.266544589 +0000 UTC m=+105.721130938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : secret "router-metrics-certs-default" not found Sep 10 17:41:21.766842 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:21.766656 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 17:41:21.766842 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:21.766695 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert podName:d904b533-dca6-4546-a1a3-4e85c1caff35 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:22.266683644 +0000 UTC m=+105.721269961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-kmk69" (UID: "d904b533-dca6-4546-a1a3-4e85c1caff35") : secret "networking-console-plugin-cert" not found Sep 10 17:41:21.767076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.767050 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d904b533-dca6-4546-a1a3-4e85c1caff35-nginx-conf\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:21.768796 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.768774 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-default-certificate\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.768961 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.768941 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-stats-auth\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.775672 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.775648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9854j\" (UniqueName: \"kubernetes.io/projected/d86f8b3e-b713-40fd-bfa4-758114583bff-kube-api-access-9854j\") pod \"volume-data-source-validator-695c895bd6-prxhn\" (UID: \"d86f8b3e-b713-40fd-bfa4-758114583bff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" Sep 10 17:41:21.777088 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.777043 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktcfq\" (UniqueName: \"kubernetes.io/projected/afaf70a3-9531-4097-b4ff-bdd880fe0a81-kube-api-access-ktcfq\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:21.828230 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.828183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" Sep 10 17:41:21.867643 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.867615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b659243-0819-4245-b99c-32ddc6dfd8f3-serving-cert\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.867763 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.867663 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b659243-0819-4245-b99c-32ddc6dfd8f3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.867763 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.867682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hqlx\" (UniqueName: \"kubernetes.io/projected/2b659243-0819-4245-b99c-32ddc6dfd8f3-kube-api-access-7hqlx\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.867940 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.867793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b659243-0819-4245-b99c-32ddc6dfd8f3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.868844 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.868182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tshfz\" (UniqueName: \"kubernetes.io/projected/582fe5e2-d9a0-4f07-b61d-1ac0891bcab4-kube-api-access-tshfz\") pod \"network-check-source-685456655f-fd99q\" (UID: \"582fe5e2-d9a0-4f07-b61d-1ac0891bcab4\") " pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" Sep 10 17:41:21.868844 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.868252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2b659243-0819-4245-b99c-32ddc6dfd8f3-snapshots\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.868844 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.868360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b659243-0819-4245-b99c-32ddc6dfd8f3-tmp\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.969725 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.969615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b659243-0819-4245-b99c-32ddc6dfd8f3-tmp\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.969725 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.969678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b659243-0819-4245-b99c-32ddc6dfd8f3-serving-cert\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.969725 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.969712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b659243-0819-4245-b99c-32ddc6dfd8f3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.970051 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.969736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hqlx\" (UniqueName: \"kubernetes.io/projected/2b659243-0819-4245-b99c-32ddc6dfd8f3-kube-api-access-7hqlx\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.970051 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.969799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b659243-0819-4245-b99c-32ddc6dfd8f3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.970051 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.969981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tshfz\" (UniqueName: \"kubernetes.io/projected/582fe5e2-d9a0-4f07-b61d-1ac0891bcab4-kube-api-access-tshfz\") pod \"network-check-source-685456655f-fd99q\" (UID: \"582fe5e2-d9a0-4f07-b61d-1ac0891bcab4\") " pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" Sep 10 17:41:21.970229 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.970055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2b659243-0819-4245-b99c-32ddc6dfd8f3-snapshots\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.970229 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.970135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b659243-0819-4245-b99c-32ddc6dfd8f3-tmp\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.970459 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.970438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b659243-0819-4245-b99c-32ddc6dfd8f3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.970616 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.970599 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2b659243-0819-4245-b99c-32ddc6dfd8f3-snapshots\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.970922 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.970903 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b659243-0819-4245-b99c-32ddc6dfd8f3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.972106 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.972088 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b659243-0819-4245-b99c-32ddc6dfd8f3-serving-cert\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.978894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.978864 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hqlx\" (UniqueName: \"kubernetes.io/projected/2b659243-0819-4245-b99c-32ddc6dfd8f3-kube-api-access-7hqlx\") pod \"insights-operator-76bcd6ccf5-7rpps\" (UID: \"2b659243-0819-4245-b99c-32ddc6dfd8f3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:21.979033 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:21.979018 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tshfz\" (UniqueName: \"kubernetes.io/projected/582fe5e2-d9a0-4f07-b61d-1ac0891bcab4-kube-api-access-tshfz\") pod \"network-check-source-685456655f-fd99q\" (UID: \"582fe5e2-d9a0-4f07-b61d-1ac0891bcab4\") " pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" Sep 10 17:41:22.006175 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.006145 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr"] Sep 10 17:41:22.009016 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:22.008990 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f52e1c_c3d1_4215_819b_e4f7527811e6.slice/crio-b85b36cef0cc764d1455a1766ba3d5c2b3fd601a6ee92f0c2b8862beb95c0537 WatchSource:0}: Error finding container b85b36cef0cc764d1455a1766ba3d5c2b3fd601a6ee92f0c2b8862beb95c0537: Status 404 returned error can't find the container with id b85b36cef0cc764d1455a1766ba3d5c2b3fd601a6ee92f0c2b8862beb95c0537 Sep 10 17:41:22.030883 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.030857 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" Sep 10 17:41:22.058928 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.058907 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" Sep 10 17:41:22.126559 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.126523 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn"] Sep 10 17:41:22.131113 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:22.131060 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86f8b3e_b713_40fd_bfa4_758114583bff.slice/crio-5e242fb6cfb357fc615c0d8e03590098abdbe98ab00c3efc177af704a876b185 WatchSource:0}: Error finding container 5e242fb6cfb357fc615c0d8e03590098abdbe98ab00c3efc177af704a876b185: Status 404 returned error can't find the container with id 5e242fb6cfb357fc615c0d8e03590098abdbe98ab00c3efc177af704a876b185 Sep 10 17:41:22.272605 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.272494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:22.272605 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.272560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:22.272605 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.272597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:22.272869 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:22.272669 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:23.272649113 +0000 UTC m=+106.727235465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : configmap references non-existent config key: service-ca.crt Sep 10 17:41:22.272869 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:22.272697 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 17:41:22.272869 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:22.272702 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:41:22.272869 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:22.272746 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert podName:d904b533-dca6-4546-a1a3-4e85c1caff35 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:23.272732694 +0000 UTC m=+106.727319029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-kmk69" (UID: "d904b533-dca6-4546-a1a3-4e85c1caff35") : secret "networking-console-plugin-cert" not found Sep 10 17:41:22.272869 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:22.272760 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:23.272753748 +0000 UTC m=+106.727340060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : secret "router-metrics-certs-default" not found Sep 10 17:41:22.324096 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.324067 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-fd99q"] Sep 10 17:41:22.326933 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:22.326906 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582fe5e2_d9a0_4f07_b61d_1ac0891bcab4.slice/crio-d1c1fe44e33cf6783d22650b0cdd383b2a64cb9df0ad53a6c85bbf163d4db707 WatchSource:0}: Error finding container d1c1fe44e33cf6783d22650b0cdd383b2a64cb9df0ad53a6c85bbf163d4db707: Status 404 returned error can't find the container with id d1c1fe44e33cf6783d22650b0cdd383b2a64cb9df0ad53a6c85bbf163d4db707 Sep 10 17:41:22.346150 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.346127 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-7rpps"] Sep 10 17:41:22.355751 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:22.355722 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b659243_0819_4245_b99c_32ddc6dfd8f3.slice/crio-07641c03821ad352a24de52aee5d8f920d786cb16f5dd23c1a53c858c88e4dec WatchSource:0}: Error finding container 07641c03821ad352a24de52aee5d8f920d786cb16f5dd23c1a53c858c88e4dec: Status 404 returned error can't find the container with id 07641c03821ad352a24de52aee5d8f920d786cb16f5dd23c1a53c858c88e4dec Sep 10 17:41:22.473554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.473515 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" event={"ID":"582fe5e2-d9a0-4f07-b61d-1ac0891bcab4","Type":"ContainerStarted","Data":"302f6668f754cd136c8864fd1870dfbadc99ae9474768d0d4c9cef7d96922d55"} Sep 10 17:41:22.474004 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.473576 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" event={"ID":"582fe5e2-d9a0-4f07-b61d-1ac0891bcab4","Type":"ContainerStarted","Data":"d1c1fe44e33cf6783d22650b0cdd383b2a64cb9df0ad53a6c85bbf163d4db707"} Sep 10 17:41:22.474766 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.474743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" event={"ID":"b4f52e1c-c3d1-4215-819b-e4f7527811e6","Type":"ContainerStarted","Data":"b85b36cef0cc764d1455a1766ba3d5c2b3fd601a6ee92f0c2b8862beb95c0537"} Sep 10 17:41:22.475927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.475903 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" event={"ID":"d86f8b3e-b713-40fd-bfa4-758114583bff","Type":"ContainerStarted","Data":"5e242fb6cfb357fc615c0d8e03590098abdbe98ab00c3efc177af704a876b185"} Sep 10 17:41:22.477053 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.477023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" event={"ID":"2b659243-0819-4245-b99c-32ddc6dfd8f3","Type":"ContainerStarted","Data":"07641c03821ad352a24de52aee5d8f920d786cb16f5dd23c1a53c858c88e4dec"} Sep 10 17:41:22.490426 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:22.490386 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-fd99q" podStartSLOduration=1.490374272 podStartE2EDuration="1.490374272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:22.489392151 +0000 UTC m=+105.943978485" watchObservedRunningTime="2026-09-10 17:41:22.490374272 +0000 UTC m=+105.944960605" Sep 10 17:41:23.281838 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:23.281728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:23.282056 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:23.281944 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:41:23.282056 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:23.281995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:23.282056 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:23.282035 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:25.281999076 +0000 UTC m=+108.736585405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : secret "router-metrics-certs-default" not found Sep 10 17:41:23.282234 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:23.282122 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 17:41:23.282234 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:23.282130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:23.282234 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:23.282178 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert podName:d904b533-dca6-4546-a1a3-4e85c1caff35 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:25.282161315 +0000 UTC m=+108.736747645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-kmk69" (UID: "d904b533-dca6-4546-a1a3-4e85c1caff35") : secret "networking-console-plugin-cert" not found Sep 10 17:41:23.282376 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:23.282239 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:25.282228026 +0000 UTC m=+108.736814375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : configmap references non-existent config key: service-ca.crt Sep 10 17:41:23.485511 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:23.485475 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" event={"ID":"d86f8b3e-b713-40fd-bfa4-758114583bff","Type":"ContainerStarted","Data":"2a77e524adc66bc833e9c4c2da64780f16a68a8d0b5bb48408727c81b889a738"} Sep 10 17:41:23.502188 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:23.501749 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-prxhn" podStartSLOduration=1.277600417 podStartE2EDuration="2.50172604s" totalImagesPullingTime="1.224125623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:23.50103774 +0000 UTC m=+106.955624076" watchObservedRunningTime="2026-09-10 17:41:23.50172604 +0000 UTC m=+106.956312377" Sep 10 17:41:25.300430 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:25.300321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:25.300874 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:25.300499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:25.300874 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:25.300578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:25.300874 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:25.300503 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:41:25.300874 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:25.300562 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 17:41:25.300874 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:25.300692 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:29.300666463 +0000 UTC m=+112.755252778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : secret "router-metrics-certs-default" not found Sep 10 17:41:25.300874 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:25.300713 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:29.300703983 +0000 UTC m=+112.755290296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : configmap references non-existent config key: service-ca.crt Sep 10 17:41:25.300874 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:25.300728 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert podName:d904b533-dca6-4546-a1a3-4e85c1caff35 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:29.30072042 +0000 UTC m=+112.755306732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-kmk69" (UID: "d904b533-dca6-4546-a1a3-4e85c1caff35") : secret "networking-console-plugin-cert" not found Sep 10 17:41:25.494225 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:25.494186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" event={"ID":"b4f52e1c-c3d1-4215-819b-e4f7527811e6","Type":"ContainerStarted","Data":"8d7e2bd7b2bb9656e44f75f762741e7ba7af3ad9395731cb5ffcd11f93f41ddd"} Sep 10 17:41:25.495899 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:25.495876 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" event={"ID":"2b659243-0819-4245-b99c-32ddc6dfd8f3","Type":"ContainerStarted","Data":"e2726a3c465421f6c4896220e106c5f2978e88c8f6cc020ba3d6e307ae956c87"} Sep 10 17:41:25.517500 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:25.517444 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" podStartSLOduration=1.549903649 podStartE2EDuration="4.517422896s" totalImagesPullingTime="2.967519247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:25.516515773 +0000 UTC m=+108.971102109" watchObservedRunningTime="2026-09-10 17:41:25.517422896 +0000 UTC m=+108.972009226" Sep 10 17:41:25.542238 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:25.542176 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" podStartSLOduration=1.922998105 podStartE2EDuration="4.542153174s" totalImagesPullingTime="2.619155069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:25.540059781 +0000 UTC m=+108.994646118" watchObservedRunningTime="2026-09-10 17:41:25.542153174 +0000 UTC m=+108.996739511" Sep 10 17:41:26.351097 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.351056 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jpmkl"] Sep 10 17:41:26.353467 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.353449 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.355520 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.355496 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ktmw7\"" Sep 10 17:41:26.355946 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.355931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 17:41:26.356018 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.355955 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 17:41:26.373475 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.373447 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpmkl"] Sep 10 17:41:26.512665 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.512629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4887adee-3910-430f-a228-94c0520c8b11-crio-socket\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.512665 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.512660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4887adee-3910-430f-a228-94c0520c8b11-data-volume\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.512921 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.512793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.512921 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.512850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.512921 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.512870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trw5j\" (UniqueName: \"kubernetes.io/projected/4887adee-3910-430f-a228-94c0520c8b11-kube-api-access-trw5j\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.613624 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.613542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.613624 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.613591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.613635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trw5j\" (UniqueName: \"kubernetes.io/projected/4887adee-3910-430f-a228-94c0520c8b11-kube-api-access-trw5j\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:26.613666 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:26.613732 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:27.113711979 +0000 UTC m=+110.568298307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : configmap "kube-rbac-proxy" not found Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:26.613733 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.613762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4887adee-3910-430f-a228-94c0520c8b11-crio-socket\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:26.613799 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:27.113779135 +0000 UTC m=+110.568365451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.613853 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4887adee-3910-430f-a228-94c0520c8b11-crio-socket\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.614005 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.613865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4887adee-3910-430f-a228-94c0520c8b11-data-volume\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.614326 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.614180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4887adee-3910-430f-a228-94c0520c8b11-data-volume\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:26.622663 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:26.622639 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trw5j\" (UniqueName: \"kubernetes.io/projected/4887adee-3910-430f-a228-94c0520c8b11-kube-api-access-trw5j\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:27.118931 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:27.118895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:27.118931 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:27.118937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:27.119151 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:27.119023 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:27.119151 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:27.119041 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:27.119151 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:27.119090 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:28.119074117 +0000 UTC m=+111.573660460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : configmap "kube-rbac-proxy" not found Sep 10 17:41:27.119151 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:27.119104 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:28.11909841 +0000 UTC m=+111.573684722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:28.126337 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:28.126297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:28.126796 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:28.126357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:28.126796 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:28.126461 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:28.126796 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:28.126496 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:28.126796 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:28.126555 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:30.126535036 +0000 UTC m=+113.581121372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : configmap "kube-rbac-proxy" not found Sep 10 17:41:28.126796 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:28.126575 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:30.126566557 +0000 UTC m=+113.581152869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:29.091030 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:29.091005 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lqnv_52a3092a-02fa-4419-bbd1-23e9045afcba/dns-node-resolver/0.log" Sep 10 17:41:29.337031 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:29.336998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:29.337461 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:29.337095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:29.337461 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:29.337122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:29.337461 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:29.337169 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:41:29.337461 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:29.337227 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:37.337213056 +0000 UTC m=+120.791799382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : configmap references non-existent config key: service-ca.crt Sep 10 17:41:29.337461 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:29.337240 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:37.33723485 +0000 UTC m=+120.791821163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : secret "router-metrics-certs-default" not found Sep 10 17:41:29.337461 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:29.337246 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 17:41:29.337461 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:29.337304 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert podName:d904b533-dca6-4546-a1a3-4e85c1caff35 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:37.337290047 +0000 UTC m=+120.791876360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-kmk69" (UID: "d904b533-dca6-4546-a1a3-4e85c1caff35") : secret "networking-console-plugin-cert" not found Sep 10 17:41:30.144644 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:30.144608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:30.144644 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:30.144648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:30.144866 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:30.144735 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:30.144866 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:30.144789 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:30.144866 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:30.144799 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:34.144783536 +0000 UTC m=+117.599369875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : configmap "kube-rbac-proxy" not found Sep 10 17:41:30.144866 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:30.144846 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:34.14483359 +0000 UTC m=+117.599419916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:30.290365 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:30.290340 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pxk7s_e443e321-aea0-4c13-8bf7-4eb60d3ff024/node-ca/0.log" Sep 10 17:41:30.890943 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:30.890910 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8fsr_04acc994-5125-44f9-9285-8262cd834126/serve-healthcheck-canary/0.log" Sep 10 17:41:34.175006 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:34.174963 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:34.175006 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:34.175010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:34.175486 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:34.175121 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:34.175486 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:34.175146 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:34.175486 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:34.175222 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:42.175201337 +0000 UTC m=+125.629787670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : configmap "kube-rbac-proxy" not found Sep 10 17:41:34.175486 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:34.175248 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:42.175237892 +0000 UTC m=+125.629824227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:37.401707 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:37.401661 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:37.402163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:37.401720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:37.402163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:37.401752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:37.402163 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:37.401835 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 17:41:37.402163 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:37.401907 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert podName:d904b533-dca6-4546-a1a3-4e85c1caff35 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:53.401890759 +0000 UTC m=+136.856477094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-kmk69" (UID: "d904b533-dca6-4546-a1a3-4e85c1caff35") : secret "networking-console-plugin-cert" not found Sep 10 17:41:37.402163 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:37.401950 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:53.401928381 +0000 UTC m=+136.856514727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : configmap references non-existent config key: service-ca.crt Sep 10 17:41:37.402163 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:37.401949 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:41:37.402163 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:37.401994 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs podName:afaf70a3-9531-4097-b4ff-bdd880fe0a81 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:53.401985825 +0000 UTC m=+136.856572138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs") pod "router-default-5bf59cb5f4-58bgz" (UID: "afaf70a3-9531-4097-b4ff-bdd880fe0a81") : secret "router-metrics-certs-default" not found Sep 10 17:41:42.245129 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:42.245094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:42.245641 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:42.245139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:42.245641 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:42.245308 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:42.245641 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:41:42.245379 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls podName:4887adee-3910-430f-a228-94c0520c8b11 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:58.245364271 +0000 UTC m=+141.699950597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmkl" (UID: "4887adee-3910-430f-a228-94c0520c8b11") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:42.245855 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:42.245743 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4887adee-3910-430f-a228-94c0520c8b11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:45.872399 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:45.872352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:41:45.874638 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:45.874617 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85c5df57-ce4d-4f92-92ea-ddb6735e3b59-metrics-certs\") pod \"network-metrics-daemon-dkfgm\" (UID: \"85c5df57-ce4d-4f92-92ea-ddb6735e3b59\") " pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:41:46.014764 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:46.014732 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d22m9\"" Sep 10 17:41:46.022337 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:46.022320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkfgm" Sep 10 17:41:46.289528 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:46.289448 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dkfgm"] Sep 10 17:41:46.292308 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:46.292283 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c5df57_ce4d_4f92_92ea_ddb6735e3b59.slice/crio-31ab54063202e559c899b7e44b0f745589cf285be48958cf870d8b7c3abe2934 WatchSource:0}: Error finding container 31ab54063202e559c899b7e44b0f745589cf285be48958cf870d8b7c3abe2934: Status 404 returned error can't find the container with id 31ab54063202e559c899b7e44b0f745589cf285be48958cf870d8b7c3abe2934 Sep 10 17:41:46.563448 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:46.563361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dkfgm" event={"ID":"85c5df57-ce4d-4f92-92ea-ddb6735e3b59","Type":"ContainerStarted","Data":"31ab54063202e559c899b7e44b0f745589cf285be48958cf870d8b7c3abe2934"} Sep 10 17:41:47.568246 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:47.568207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dkfgm" event={"ID":"85c5df57-ce4d-4f92-92ea-ddb6735e3b59","Type":"ContainerStarted","Data":"7d921bbef7d2f7a4edfd755acbb9092ce9ab16722aa578d7267de9a1e869d4a2"} Sep 10 17:41:47.568687 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:47.568263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dkfgm" event={"ID":"85c5df57-ce4d-4f92-92ea-ddb6735e3b59","Type":"ContainerStarted","Data":"073b69ba1cd8587e24ee88a04a3301696549e5cc00b833b0fce35ef9b77fdf76"} Sep 10 17:41:47.590183 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:47.590135 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dkfgm" podStartSLOduration=129.768518976 podStartE2EDuration="2m10.590119363s" totalImagesPullingTime="821.600387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:47.587240238 +0000 UTC m=+131.041826584" watchObservedRunningTime="2026-09-10 17:41:47.590119363 +0000 UTC m=+131.044705697" Sep 10 17:41:49.116398 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.116360 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd"] Sep 10 17:41:49.118457 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.118442 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.121892 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.121871 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 10 17:41:49.122251 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.122227 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 17:41:49.122357 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.122331 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 10 17:41:49.122490 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.122475 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 10 17:41:49.122901 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.122888 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 10 17:41:49.123019 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.123002 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 17:41:49.125320 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.125029 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 17:41:49.133356 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.133336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd"] Sep 10 17:41:49.196385 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.196357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-ca\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.196385 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.196387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.196583 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.196466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.196583 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.196494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfvhf\" (UniqueName: \"kubernetes.io/projected/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-kube-api-access-gfvhf\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.196583 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.196547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-hub\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.196583 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.196578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.297557 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.297519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfvhf\" (UniqueName: \"kubernetes.io/projected/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-kube-api-access-gfvhf\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.297557 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.297558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-hub\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.297765 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.297576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.297765 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.297624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-ca\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.297765 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.297640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.297765 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.297698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.298418 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.298380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.300276 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.300253 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.300365 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.300256 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-hub\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.300500 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.300486 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-ca\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.300600 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.300572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.326387 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.326359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfvhf\" (UniqueName: \"kubernetes.io/projected/42cf65a8-74a7-4def-b8bc-4e7c823e4dc5-kube-api-access-gfvhf\") pod \"cluster-proxy-proxy-agent-b9f896cbb-trdkd\" (UID: \"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.440021 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.439920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" Sep 10 17:41:49.722511 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:49.722431 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd"] Sep 10 17:41:49.725805 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:49.725755 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42cf65a8_74a7_4def_b8bc_4e7c823e4dc5.slice/crio-63d0898de585e5c2175826c4140bdb0ca52cfb73526bb174204c3186e96a00ce WatchSource:0}: Error finding container 63d0898de585e5c2175826c4140bdb0ca52cfb73526bb174204c3186e96a00ce: Status 404 returned error can't find the container with id 63d0898de585e5c2175826c4140bdb0ca52cfb73526bb174204c3186e96a00ce Sep 10 17:41:50.578808 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:50.578774 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" event={"ID":"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5","Type":"ContainerStarted","Data":"63d0898de585e5c2175826c4140bdb0ca52cfb73526bb174204c3186e96a00ce"} Sep 10 17:41:53.428006 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.427970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:53.428587 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.428115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:53.428587 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.428209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:53.429015 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.428967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afaf70a3-9531-4097-b4ff-bdd880fe0a81-service-ca-bundle\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:53.431104 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.431077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d904b533-dca6-4546-a1a3-4e85c1caff35-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-kmk69\" (UID: \"d904b533-dca6-4546-a1a3-4e85c1caff35\") " pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:53.431683 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.431640 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afaf70a3-9531-4097-b4ff-bdd880fe0a81-metrics-certs\") pod \"router-default-5bf59cb5f4-58bgz\" (UID: \"afaf70a3-9531-4097-b4ff-bdd880fe0a81\") " pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:53.651795 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.651762 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zk8t4\"" Sep 10 17:41:53.659652 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.659624 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" Sep 10 17:41:53.672959 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.672939 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-scp2l\"" Sep 10 17:41:53.680759 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:53.680702 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:54.125064 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:54.125015 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-kmk69"] Sep 10 17:41:54.128008 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:54.127978 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bf59cb5f4-58bgz"] Sep 10 17:41:55.120272 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:55.120234 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd904b533_dca6_4546_a1a3_4e85c1caff35.slice/crio-e9c2fd14fa778c14809f8ca75907f45040c054f1f06daa30df985219ea00307d WatchSource:0}: Error finding container e9c2fd14fa778c14809f8ca75907f45040c054f1f06daa30df985219ea00307d: Status 404 returned error can't find the container with id e9c2fd14fa778c14809f8ca75907f45040c054f1f06daa30df985219ea00307d Sep 10 17:41:55.120710 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:55.120441 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafaf70a3_9531_4097_b4ff_bdd880fe0a81.slice/crio-c9b511dad9e1147fb4dfc6b7b26ffd651744b894cafe487ab1edf308c2b48988 WatchSource:0}: Error finding container c9b511dad9e1147fb4dfc6b7b26ffd651744b894cafe487ab1edf308c2b48988: Status 404 returned error can't find the container with id c9b511dad9e1147fb4dfc6b7b26ffd651744b894cafe487ab1edf308c2b48988 Sep 10 17:41:55.598448 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.598363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" event={"ID":"afaf70a3-9531-4097-b4ff-bdd880fe0a81","Type":"ContainerStarted","Data":"8740df9bc82bd837f9b6ee5b9fefa458e95620db6104fb785136691206a6f8fc"} Sep 10 17:41:55.598448 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.598421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" event={"ID":"afaf70a3-9531-4097-b4ff-bdd880fe0a81","Type":"ContainerStarted","Data":"c9b511dad9e1147fb4dfc6b7b26ffd651744b894cafe487ab1edf308c2b48988"} Sep 10 17:41:55.600321 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.600297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" event={"ID":"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5","Type":"ContainerStarted","Data":"065338b69c8bcb798b616c3d37338f65d9e5a726fca118ae4edcf45bb62cc522"} Sep 10 17:41:55.600447 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.600330 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" event={"ID":"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5","Type":"ContainerStarted","Data":"6d3d19689e9c5e1fc0c043914db299d63244a8c631eb2ed4fe5baa9a3bce64bc"} Sep 10 17:41:55.600447 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.600345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" event={"ID":"42cf65a8-74a7-4def-b8bc-4e7c823e4dc5","Type":"ContainerStarted","Data":"04e7466e10f971cc50bbe7cd58715b05a06a0a7b7bec658ef29663633fa9c1e2"} Sep 10 17:41:55.601340 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.601316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" event={"ID":"d904b533-dca6-4546-a1a3-4e85c1caff35","Type":"ContainerStarted","Data":"e9c2fd14fa778c14809f8ca75907f45040c054f1f06daa30df985219ea00307d"} Sep 10 17:41:55.619547 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.619498 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" podStartSLOduration=34.619481384 podStartE2EDuration="34.619481384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:55.618045647 +0000 UTC m=+139.072631983" watchObservedRunningTime="2026-09-10 17:41:55.619481384 +0000 UTC m=+139.074067720" Sep 10 17:41:55.680938 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.680906 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:55.684076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.684054 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:55.716645 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:55.716585 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b9f896cbb-trdkd" podStartSLOduration=1.254388657 podStartE2EDuration="6.716565575s" totalImagesPullingTime="5.462176918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:55.648884306 +0000 UTC m=+139.103470656" watchObservedRunningTime="2026-09-10 17:41:55.716565575 +0000 UTC m=+139.171151901" Sep 10 17:41:56.606583 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:56.606489 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" event={"ID":"d904b533-dca6-4546-a1a3-4e85c1caff35","Type":"ContainerStarted","Data":"9468e14b2db6bcaafb661f3db36ffc20b6d4ace3b8e109e84939c9a22144a2a4"} Sep 10 17:41:56.607046 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:56.606583 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:56.607985 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:56.607969 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bf59cb5f4-58bgz" Sep 10 17:41:56.623007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:56.622962 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-kmk69" podStartSLOduration=34.47985358 podStartE2EDuration="35.622949209s" totalImagesPullingTime="1.143095629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:56.621412918 +0000 UTC m=+140.075999255" watchObservedRunningTime="2026-09-10 17:41:56.622949209 +0000 UTC m=+140.077535585" Sep 10 17:41:58.268154 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:58.268116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:58.270427 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:58.270401 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4887adee-3910-430f-a228-94c0520c8b11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmkl\" (UID: \"4887adee-3910-430f-a228-94c0520c8b11\") " pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:58.464643 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:58.464607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ktmw7\"" Sep 10 17:41:58.473289 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:58.473265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpmkl" Sep 10 17:41:58.744493 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:58.744463 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpmkl"] Sep 10 17:41:58.747405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:41:58.747382 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4887adee_3910_430f_a228_94c0520c8b11.slice/crio-5171c9e06c03a28297c00ceea9eda14676ddd624a3f99e81c170c6ffc502f747 WatchSource:0}: Error finding container 5171c9e06c03a28297c00ceea9eda14676ddd624a3f99e81c170c6ffc502f747: Status 404 returned error can't find the container with id 5171c9e06c03a28297c00ceea9eda14676ddd624a3f99e81c170c6ffc502f747 Sep 10 17:41:59.619060 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:59.619025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmkl" event={"ID":"4887adee-3910-430f-a228-94c0520c8b11","Type":"ContainerStarted","Data":"0ada278643aad888710f83d212f5a3d356436cd86d6c1e4ef2e4967d06269bd9"} Sep 10 17:41:59.619442 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:59.619119 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmkl" event={"ID":"4887adee-3910-430f-a228-94c0520c8b11","Type":"ContainerStarted","Data":"7c1b9f22a66e323b3b7e2e161d77955047dd0554b024fbabd6af73e9750c894c"} Sep 10 17:41:59.619442 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:41:59.619151 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmkl" event={"ID":"4887adee-3910-430f-a228-94c0520c8b11","Type":"ContainerStarted","Data":"5171c9e06c03a28297c00ceea9eda14676ddd624a3f99e81c170c6ffc502f747"} Sep 10 17:42:01.628055 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:01.628017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmkl" event={"ID":"4887adee-3910-430f-a228-94c0520c8b11","Type":"ContainerStarted","Data":"f09457e8feddc5cacca7031fc0dc8cceae3743ae5de9111580d2aab7b962f124"} Sep 10 17:42:01.646905 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:01.646858 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jpmkl" podStartSLOduration=33.848099685 podStartE2EDuration="35.646842801s" totalImagesPullingTime="1.798743116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:01.646135427 +0000 UTC m=+145.100721773" watchObservedRunningTime="2026-09-10 17:42:01.646842801 +0000 UTC m=+145.101429130" Sep 10 17:42:05.558110 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.558070 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t5v75"] Sep 10 17:42:05.561673 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.561650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.563747 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.563727 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 17:42:05.563911 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.563894 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nplqf\"" Sep 10 17:42:05.564305 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.564290 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 17:42:05.564396 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.564330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 17:42:05.564457 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.564394 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 17:42:05.564457 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.564412 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 17:42:05.564554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.564542 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 17:42:05.627444 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627412 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627444 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-wtmp\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627613 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-root\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627613 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-metrics-client-ca\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627613 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-sys\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627613 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-tls\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627734 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627734 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-textfile\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.627734 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.627720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d95bb\" (UniqueName: \"kubernetes.io/projected/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-kube-api-access-d95bb\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728557 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-metrics-client-ca\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728557 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-sys\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-tls\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-textfile\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728654 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-sys\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d95bb\" (UniqueName: \"kubernetes.io/projected/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-kube-api-access-d95bb\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.728748 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.729023 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:42:05.728747 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 17:42:05.729023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-wtmp\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.729023 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:42:05.728861 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-tls podName:d9f6e299-6b4e-4f25-8999-2cfb40fb43ab nodeName:}" failed. No retries permitted until 2026-09-10 17:42:06.228839349 +0000 UTC m=+149.683425668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-tls") pod "node-exporter-t5v75" (UID: "d9f6e299-6b4e-4f25-8999-2cfb40fb43ab") : secret "node-exporter-tls" not found Sep 10 17:42:05.729023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.728892 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-wtmp\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.729326 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.729301 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-textfile\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.729398 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.729386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-root\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.729554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.729520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-root\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.729710 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.729626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-metrics-client-ca\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.729791 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.729678 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.733593 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.731408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:05.737318 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:05.737297 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d95bb\" (UniqueName: \"kubernetes.io/projected/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-kube-api-access-d95bb\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:06.233466 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:06.233431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-tls\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:06.235635 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:06.235615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9f6e299-6b4e-4f25-8999-2cfb40fb43ab-node-exporter-tls\") pod \"node-exporter-t5v75\" (UID: \"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab\") " pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:06.470614 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:06.470580 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5v75" Sep 10 17:42:06.481515 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:42:06.481487 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f6e299_6b4e_4f25_8999_2cfb40fb43ab.slice/crio-0b0877311b9df0b1834d9e417f8de7142b6f7ec146dcb841c8b7b1039ea45a80 WatchSource:0}: Error finding container 0b0877311b9df0b1834d9e417f8de7142b6f7ec146dcb841c8b7b1039ea45a80: Status 404 returned error can't find the container with id 0b0877311b9df0b1834d9e417f8de7142b6f7ec146dcb841c8b7b1039ea45a80 Sep 10 17:42:06.645608 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:06.645571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5v75" event={"ID":"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab","Type":"ContainerStarted","Data":"0b0877311b9df0b1834d9e417f8de7142b6f7ec146dcb841c8b7b1039ea45a80"} Sep 10 17:42:07.650713 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:07.650682 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9f6e299-6b4e-4f25-8999-2cfb40fb43ab" containerID="66ee1840c891a9e204328d011ccec97c2216fc77d2bc71565a209b6e5ce892c2" exitCode=0 Sep 10 17:42:07.651104 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:07.650779 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5v75" event={"ID":"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab","Type":"ContainerDied","Data":"66ee1840c891a9e204328d011ccec97c2216fc77d2bc71565a209b6e5ce892c2"} Sep 10 17:42:08.656315 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:08.656282 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5v75" event={"ID":"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab","Type":"ContainerStarted","Data":"b4e8312668fb801682dcb17245b2b1fb4fc81f73fc300528e9ad3cea41ae21ef"} Sep 10 17:42:08.656725 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:08.656338 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5v75" event={"ID":"d9f6e299-6b4e-4f25-8999-2cfb40fb43ab","Type":"ContainerStarted","Data":"1b15ff608eabee2f58e2e06b1e8880889e025a234af99b1956dbbfc77ef2e786"} Sep 10 17:42:08.686975 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:08.686899 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t5v75" podStartSLOduration=2.7891250149999998 podStartE2EDuration="3.686882808s" totalImagesPullingTime="836.641951ms" totalInitContainerRuntime="61.115842ms" isStatefulPod=true podCreationTimestamp="2026-09-10 17:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:08.685233097 +0000 UTC m=+152.139819430" watchObservedRunningTime="2026-09-10 17:42:08.686882808 +0000 UTC m=+152.141469143" Sep 10 17:42:09.792985 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.792950 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5559474478-sx6tj"] Sep 10 17:42:09.795987 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.795971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.798076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.798056 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 17:42:09.798578 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.798561 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5pase99vum5ff\"" Sep 10 17:42:09.798877 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.798861 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 17:42:09.798970 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.798932 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 17:42:09.799032 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.799008 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kxnhd\"" Sep 10 17:42:09.799093 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.799071 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 17:42:09.807647 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.807624 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5559474478-sx6tj"] Sep 10 17:42:09.865856 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.865811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v98hl\" (UniqueName: \"kubernetes.io/projected/0cb1c87b-47f4-4a03-891f-752a60980d66-kube-api-access-v98hl\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.865996 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.865882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-client-ca-bundle\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.865996 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.865916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-secret-metrics-server-tls\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.865996 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.865953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-secret-metrics-server-client-certs\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.865996 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.865993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb1c87b-47f4-4a03-891f-752a60980d66-metrics-server-audit-profiles\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.866213 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.866075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb1c87b-47f4-4a03-891f-752a60980d66-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.866213 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.866119 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb1c87b-47f4-4a03-891f-752a60980d66-audit-log\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.966880 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.966851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb1c87b-47f4-4a03-891f-752a60980d66-audit-log\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967019 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.966902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98hl\" (UniqueName: \"kubernetes.io/projected/0cb1c87b-47f4-4a03-891f-752a60980d66-kube-api-access-v98hl\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967019 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.966940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-client-ca-bundle\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967019 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.966968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-secret-metrics-server-tls\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967019 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.967003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-secret-metrics-server-client-certs\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967247 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.967033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb1c87b-47f4-4a03-891f-752a60980d66-metrics-server-audit-profiles\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967247 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.967084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb1c87b-47f4-4a03-891f-752a60980d66-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967247 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.967231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb1c87b-47f4-4a03-891f-752a60980d66-audit-log\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.967947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.967921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb1c87b-47f4-4a03-891f-752a60980d66-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.968071 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.968020 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb1c87b-47f4-4a03-891f-752a60980d66-metrics-server-audit-profiles\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.969401 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.969376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-client-ca-bundle\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.969495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.969476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-secret-metrics-server-client-certs\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.969534 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.969508 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb1c87b-47f4-4a03-891f-752a60980d66-secret-metrics-server-tls\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:09.975427 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:09.975407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v98hl\" (UniqueName: \"kubernetes.io/projected/0cb1c87b-47f4-4a03-891f-752a60980d66-kube-api-access-v98hl\") pod \"metrics-server-5559474478-sx6tj\" (UID: \"0cb1c87b-47f4-4a03-891f-752a60980d66\") " pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:10.105308 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:10.105234 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:10.380230 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:10.380198 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5559474478-sx6tj"] Sep 10 17:42:10.384785 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:42:10.384755 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb1c87b_47f4_4a03_891f_752a60980d66.slice/crio-b7af26fe3e8af1aa95b6e4d7c9361be520059b2166bd7b9759e2776adc4249ae WatchSource:0}: Error finding container b7af26fe3e8af1aa95b6e4d7c9361be520059b2166bd7b9759e2776adc4249ae: Status 404 returned error can't find the container with id b7af26fe3e8af1aa95b6e4d7c9361be520059b2166bd7b9759e2776adc4249ae Sep 10 17:42:10.664838 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:10.664723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" event={"ID":"0cb1c87b-47f4-4a03-891f-752a60980d66","Type":"ContainerStarted","Data":"b7af26fe3e8af1aa95b6e4d7c9361be520059b2166bd7b9759e2776adc4249ae"} Sep 10 17:42:12.678161 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:12.678119 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" event={"ID":"0cb1c87b-47f4-4a03-891f-752a60980d66","Type":"ContainerStarted","Data":"b88738acfe538df32fd1f6fda3e351e6aabc4d371bb6f786696231778917b659"} Sep 10 17:42:12.706867 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:12.706802 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" podStartSLOduration=2.337609165 podStartE2EDuration="3.706785194s" totalImagesPullingTime="1.369176029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:12.705197975 +0000 UTC m=+156.159784310" watchObservedRunningTime="2026-09-10 17:42:12.706785194 +0000 UTC m=+156.161371528" Sep 10 17:42:12.894948 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:42:12.894888 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-k2jpl" podUID="daa4ae8d-f32a-4dec-b25e-008beeddbc9a" Sep 10 17:42:13.681289 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:13.681253 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k2jpl" Sep 10 17:42:17.731793 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:17.731756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:42:17.734012 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:17.733990 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daa4ae8d-f32a-4dec-b25e-008beeddbc9a-metrics-tls\") pod \"dns-default-k2jpl\" (UID: \"daa4ae8d-f32a-4dec-b25e-008beeddbc9a\") " pod="openshift-dns/dns-default-k2jpl" Sep 10 17:42:17.884786 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:17.884761 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dwwmp\"" Sep 10 17:42:17.892941 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:17.892926 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k2jpl" Sep 10 17:42:18.169865 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:18.169840 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k2jpl"] Sep 10 17:42:18.172187 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:42:18.172160 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa4ae8d_f32a_4dec_b25e_008beeddbc9a.slice/crio-6b0c70ab9d6f65309fa8ac7d2525e7b037bc42d5d56bf46cc3e18095428cee1d WatchSource:0}: Error finding container 6b0c70ab9d6f65309fa8ac7d2525e7b037bc42d5d56bf46cc3e18095428cee1d: Status 404 returned error can't find the container with id 6b0c70ab9d6f65309fa8ac7d2525e7b037bc42d5d56bf46cc3e18095428cee1d Sep 10 17:42:18.705245 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:18.705206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k2jpl" event={"ID":"daa4ae8d-f32a-4dec-b25e-008beeddbc9a","Type":"ContainerStarted","Data":"6b0c70ab9d6f65309fa8ac7d2525e7b037bc42d5d56bf46cc3e18095428cee1d"} Sep 10 17:42:20.715429 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:20.715391 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k2jpl" event={"ID":"daa4ae8d-f32a-4dec-b25e-008beeddbc9a","Type":"ContainerStarted","Data":"2fc554dd56fd0c360924106aa640bff98cfab4c4e86853e2f65f82fad9a3d47b"} Sep 10 17:42:20.715920 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:20.715453 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k2jpl" event={"ID":"daa4ae8d-f32a-4dec-b25e-008beeddbc9a","Type":"ContainerStarted","Data":"f08f29aaa924799f47b95cb78f377d45b1ff170d0278461d32c113c878afa192"} Sep 10 17:42:20.715920 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:20.715510 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k2jpl" Sep 10 17:42:20.742304 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:20.742247 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k2jpl" podStartSLOduration=130.225777424 podStartE2EDuration="2m11.742226035s" totalImagesPullingTime="1.516448611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:20.741237802 +0000 UTC m=+164.195824173" watchObservedRunningTime="2026-09-10 17:42:20.742226035 +0000 UTC m=+164.196812370" Sep 10 17:42:30.105682 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:30.105585 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:30.105682 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:30.105662 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:30.721579 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:30.721548 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k2jpl" Sep 10 17:42:33.092121 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.092087 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fccb8cc7-xsz7z"] Sep 10 17:42:33.095536 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.095517 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.097610 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.097585 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 17:42:33.097747 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.097682 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 17:42:33.098298 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.098279 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 17:42:33.098298 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.098297 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 17:42:33.098518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.098350 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 17:42:33.098518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.098283 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 17:42:33.098518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.098366 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 17:42:33.098518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.098425 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9s9rn\"" Sep 10 17:42:33.105666 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.105646 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 17:42:33.106346 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.106326 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fccb8cc7-xsz7z"] Sep 10 17:42:33.255567 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.255534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdr5w\" (UniqueName: \"kubernetes.io/projected/c23170a4-2623-4543-96a2-8d3cc78043f5-kube-api-access-pdr5w\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.255702 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.255608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-oauth-config\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.255702 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.255684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-console-config\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.255789 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.255742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-service-ca\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.255789 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.255770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-trusted-ca-bundle\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.255865 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.255834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-oauth-serving-cert\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.255903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.255863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-serving-cert\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357128 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-oauth-config\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357128 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-console-config\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357128 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-service-ca\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357382 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-trusted-ca-bundle\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357382 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-oauth-serving-cert\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357382 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-serving-cert\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357513 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdr5w\" (UniqueName: \"kubernetes.io/projected/c23170a4-2623-4543-96a2-8d3cc78043f5-kube-api-access-pdr5w\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.357998 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.357968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-service-ca\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.358123 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.358044 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-console-config\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.358165 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.358134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-oauth-serving-cert\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.358281 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.358264 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-trusted-ca-bundle\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.359619 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.359598 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-oauth-config\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.359746 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.359623 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-serving-cert\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.365229 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.365196 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdr5w\" (UniqueName: \"kubernetes.io/projected/c23170a4-2623-4543-96a2-8d3cc78043f5-kube-api-access-pdr5w\") pod \"console-57fccb8cc7-xsz7z\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.405286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.405241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:33.678912 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.678690 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fccb8cc7-xsz7z"] Sep 10 17:42:33.681405 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:42:33.681371 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23170a4_2623_4543_96a2_8d3cc78043f5.slice/crio-41529924160e8836ac416cff6873bc22bdeb5774475f14d13c19b79817f34f05 WatchSource:0}: Error finding container 41529924160e8836ac416cff6873bc22bdeb5774475f14d13c19b79817f34f05: Status 404 returned error can't find the container with id 41529924160e8836ac416cff6873bc22bdeb5774475f14d13c19b79817f34f05 Sep 10 17:42:33.760209 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:33.760174 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fccb8cc7-xsz7z" event={"ID":"c23170a4-2623-4543-96a2-8d3cc78043f5","Type":"ContainerStarted","Data":"41529924160e8836ac416cff6873bc22bdeb5774475f14d13c19b79817f34f05"} Sep 10 17:42:36.772508 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:36.772429 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fccb8cc7-xsz7z" event={"ID":"c23170a4-2623-4543-96a2-8d3cc78043f5","Type":"ContainerStarted","Data":"a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b"} Sep 10 17:42:36.790989 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:36.790944 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fccb8cc7-xsz7z" podStartSLOduration=1.060096658 podStartE2EDuration="3.790925167s" totalImagesPullingTime="2.730828509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:36.790242416 +0000 UTC m=+180.244828786" watchObservedRunningTime="2026-09-10 17:42:36.790925167 +0000 UTC m=+180.245511503" Sep 10 17:42:40.788351 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:40.788314 2580 generic.go:356] "Generic (PLEG): container finished" podID="b4f52e1c-c3d1-4215-819b-e4f7527811e6" containerID="8d7e2bd7b2bb9656e44f75f762741e7ba7af3ad9395731cb5ffcd11f93f41ddd" exitCode=0 Sep 10 17:42:40.788708 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:40.788388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" event={"ID":"b4f52e1c-c3d1-4215-819b-e4f7527811e6","Type":"ContainerDied","Data":"8d7e2bd7b2bb9656e44f75f762741e7ba7af3ad9395731cb5ffcd11f93f41ddd"} Sep 10 17:42:40.788708 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:40.788702 2580 scope.go:117] "RemoveContainer" containerID="8d7e2bd7b2bb9656e44f75f762741e7ba7af3ad9395731cb5ffcd11f93f41ddd" Sep 10 17:42:41.793498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:41.793461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9gwnr" event={"ID":"b4f52e1c-c3d1-4215-819b-e4f7527811e6","Type":"ContainerStarted","Data":"66bfcc3be2814398729eb0ccd466637a5e4a8257b754a4903d808ed32fa67709"} Sep 10 17:42:43.405734 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:43.405689 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:43.406185 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:43.405754 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:43.410555 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:43.410532 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:43.804609 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:43.804526 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:42:50.110975 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:50.110943 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:50.114686 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:50.114661 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5559474478-sx6tj" Sep 10 17:42:55.847430 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:55.847362 2580 generic.go:356] "Generic (PLEG): container finished" podID="2b659243-0819-4245-b99c-32ddc6dfd8f3" containerID="e2726a3c465421f6c4896220e106c5f2978e88c8f6cc020ba3d6e307ae956c87" exitCode=0 Sep 10 17:42:55.847734 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:55.847436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" event={"ID":"2b659243-0819-4245-b99c-32ddc6dfd8f3","Type":"ContainerDied","Data":"e2726a3c465421f6c4896220e106c5f2978e88c8f6cc020ba3d6e307ae956c87"} Sep 10 17:42:55.847773 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:55.847731 2580 scope.go:117] "RemoveContainer" containerID="e2726a3c465421f6c4896220e106c5f2978e88c8f6cc020ba3d6e307ae956c87" Sep 10 17:42:56.567054 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:56.567022 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bf59cb5f4-58bgz_afaf70a3-9531-4097-b4ff-bdd880fe0a81/router/0.log" Sep 10 17:42:56.590645 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:56.590614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8fsr_04acc994-5125-44f9-9285-8262cd834126/serve-healthcheck-canary/0.log" Sep 10 17:42:56.852610 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:42:56.852536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-7rpps" event={"ID":"2b659243-0819-4245-b99c-32ddc6dfd8f3","Type":"ContainerStarted","Data":"8fa256e8038a2d8f67aa7164b6bd93b41f17dea9684fa8d97e1b0a9fc1918218"} Sep 10 17:43:45.564072 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:43:45.564037 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fccb8cc7-xsz7z"] Sep 10 17:44:10.584585 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.584478 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57fccb8cc7-xsz7z" podUID="c23170a4-2623-4543-96a2-8d3cc78043f5" containerName="console" containerID="cri-o://a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b" gracePeriod=15 Sep 10 17:44:10.826063 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.826033 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:44:10.868480 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868454 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-trusted-ca-bundle\") pod \"c23170a4-2623-4543-96a2-8d3cc78043f5\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " Sep 10 17:44:10.868606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868499 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-oauth-config\") pod \"c23170a4-2623-4543-96a2-8d3cc78043f5\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " Sep 10 17:44:10.868606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868525 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-oauth-serving-cert\") pod \"c23170a4-2623-4543-96a2-8d3cc78043f5\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " Sep 10 17:44:10.868606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868562 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-serving-cert\") pod \"c23170a4-2623-4543-96a2-8d3cc78043f5\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " Sep 10 17:44:10.868739 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868608 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-console-config\") pod \"c23170a4-2623-4543-96a2-8d3cc78043f5\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " Sep 10 17:44:10.868739 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868640 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-service-ca\") pod \"c23170a4-2623-4543-96a2-8d3cc78043f5\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " Sep 10 17:44:10.868739 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868667 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdr5w\" (UniqueName: \"kubernetes.io/projected/c23170a4-2623-4543-96a2-8d3cc78043f5-kube-api-access-pdr5w\") pod \"c23170a4-2623-4543-96a2-8d3cc78043f5\" (UID: \"c23170a4-2623-4543-96a2-8d3cc78043f5\") " Sep 10 17:44:10.868910 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.868872 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c23170a4-2623-4543-96a2-8d3cc78043f5" (UID: "c23170a4-2623-4543-96a2-8d3cc78043f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:44:10.869067 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.869045 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c23170a4-2623-4543-96a2-8d3cc78043f5" (UID: "c23170a4-2623-4543-96a2-8d3cc78043f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:44:10.869131 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.869049 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-console-config" (OuterVolumeSpecName: "console-config") pod "c23170a4-2623-4543-96a2-8d3cc78043f5" (UID: "c23170a4-2623-4543-96a2-8d3cc78043f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:44:10.869131 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.869070 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "c23170a4-2623-4543-96a2-8d3cc78043f5" (UID: "c23170a4-2623-4543-96a2-8d3cc78043f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:44:10.870725 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.870699 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c23170a4-2623-4543-96a2-8d3cc78043f5" (UID: "c23170a4-2623-4543-96a2-8d3cc78043f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:44:10.870811 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.870790 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c23170a4-2623-4543-96a2-8d3cc78043f5" (UID: "c23170a4-2623-4543-96a2-8d3cc78043f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:44:10.870811 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.870800 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23170a4-2623-4543-96a2-8d3cc78043f5-kube-api-access-pdr5w" (OuterVolumeSpecName: "kube-api-access-pdr5w") pod "c23170a4-2623-4543-96a2-8d3cc78043f5" (UID: "c23170a4-2623-4543-96a2-8d3cc78043f5"). InnerVolumeSpecName "kube-api-access-pdr5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:44:10.970122 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.970093 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-oauth-serving-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:44:10.970122 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.970119 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-serving-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:44:10.970279 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.970133 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-console-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:44:10.970279 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.970146 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-service-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:44:10.970279 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.970158 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdr5w\" (UniqueName: \"kubernetes.io/projected/c23170a4-2623-4543-96a2-8d3cc78043f5-kube-api-access-pdr5w\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:44:10.970279 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.970169 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23170a4-2623-4543-96a2-8d3cc78043f5-trusted-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:44:10.970279 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:10.970181 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23170a4-2623-4543-96a2-8d3cc78043f5-console-oauth-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:44:11.117280 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.117253 2580 generic.go:356] "Generic (PLEG): container finished" podID="c23170a4-2623-4543-96a2-8d3cc78043f5" containerID="a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b" exitCode=0 Sep 10 17:44:11.117450 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.117296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fccb8cc7-xsz7z" event={"ID":"c23170a4-2623-4543-96a2-8d3cc78043f5","Type":"ContainerDied","Data":"a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b"} Sep 10 17:44:11.117450 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.117336 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fccb8cc7-xsz7z" event={"ID":"c23170a4-2623-4543-96a2-8d3cc78043f5","Type":"ContainerDied","Data":"41529924160e8836ac416cff6873bc22bdeb5774475f14d13c19b79817f34f05"} Sep 10 17:44:11.117450 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.117355 2580 scope.go:117] "RemoveContainer" containerID="a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b" Sep 10 17:44:11.117450 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.117297 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fccb8cc7-xsz7z" Sep 10 17:44:11.125779 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.125762 2580 scope.go:117] "RemoveContainer" containerID="a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b" Sep 10 17:44:11.126097 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:44:11.126076 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b\": container with ID starting with a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b not found: ID does not exist" containerID="a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b" Sep 10 17:44:11.126145 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.126105 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b"} err="failed to get container status \"a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b\": rpc error: code = NotFound desc = could not find container \"a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b\": container with ID starting with a88b241e96c1efb83b2338e3d95e74a942e5dfbf01b4df5d1b1def9e61bdba8b not found: ID does not exist" Sep 10 17:44:11.135666 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.135641 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fccb8cc7-xsz7z"] Sep 10 17:44:11.139243 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:11.139220 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fccb8cc7-xsz7z"] Sep 10 17:44:12.994227 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:12.994195 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c23170a4-2623-4543-96a2-8d3cc78043f5" path="/var/lib/kubelet/pods/c23170a4-2623-4543-96a2-8d3cc78043f5/volumes" Sep 10 17:44:36.904864 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:36.904838 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:44:36.909073 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:36.909048 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 17:44:36.911070 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:36.910954 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:44:53.897322 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.897288 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8869546f6-52tgp"] Sep 10 17:44:53.899648 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.897525 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23170a4-2623-4543-96a2-8d3cc78043f5" containerName="console" Sep 10 17:44:53.899648 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.897537 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23170a4-2623-4543-96a2-8d3cc78043f5" containerName="console" Sep 10 17:44:53.899648 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.897591 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c23170a4-2623-4543-96a2-8d3cc78043f5" containerName="console" Sep 10 17:44:53.900453 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.900437 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:53.902367 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.902341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 17:44:53.902494 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.902415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 17:44:53.903257 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.903241 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 17:44:53.903257 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.903248 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9s9rn\"" Sep 10 17:44:53.903393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.903262 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 17:44:53.903570 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.903552 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 17:44:53.903678 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.903551 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 17:44:53.903678 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.903672 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 17:44:53.908138 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.908120 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 17:44:53.914649 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.914631 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8869546f6-52tgp"] Sep 10 17:44:53.987794 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.987764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-oauth-serving-cert\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:53.987947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.987805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-oauth-config\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:53.987947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.987834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-console-config\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:53.987947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.987920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-trusted-ca-bundle\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:53.988047 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.987949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-service-ca\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:53.988047 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.987997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88vq\" (UniqueName: \"kubernetes.io/projected/03b99272-19b2-4925-895b-c93bbc879ac9-kube-api-access-d88vq\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:53.988047 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:53.988020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-serving-cert\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089044 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-oauth-serving-cert\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089222 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-oauth-config\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089222 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-console-config\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089222 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-trusted-ca-bundle\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089379 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-service-ca\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089379 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88vq\" (UniqueName: \"kubernetes.io/projected/03b99272-19b2-4925-895b-c93bbc879ac9-kube-api-access-d88vq\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089379 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-serving-cert\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.089883 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089856 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-oauth-serving-cert\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.090016 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089946 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-console-config\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.090016 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.089980 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-service-ca\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.090104 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.090042 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-trusted-ca-bundle\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.091555 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.091533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-oauth-config\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.091792 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.091771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-serving-cert\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.097149 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.097131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88vq\" (UniqueName: \"kubernetes.io/projected/03b99272-19b2-4925-895b-c93bbc879ac9-kube-api-access-d88vq\") pod \"console-8869546f6-52tgp\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.210459 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.210360 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:44:54.477533 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:54.477410 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8869546f6-52tgp"] Sep 10 17:44:54.480039 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:44:54.480010 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b99272_19b2_4925_895b_c93bbc879ac9.slice/crio-3ed060b9ebef50d5a801ac9fc6d49765171782f816fb24e71f6c894d9441e7fb WatchSource:0}: Error finding container 3ed060b9ebef50d5a801ac9fc6d49765171782f816fb24e71f6c894d9441e7fb: Status 404 returned error can't find the container with id 3ed060b9ebef50d5a801ac9fc6d49765171782f816fb24e71f6c894d9441e7fb Sep 10 17:44:55.280264 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:55.280227 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8869546f6-52tgp" event={"ID":"03b99272-19b2-4925-895b-c93bbc879ac9","Type":"ContainerStarted","Data":"e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a"} Sep 10 17:44:55.280735 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:55.280275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8869546f6-52tgp" event={"ID":"03b99272-19b2-4925-895b-c93bbc879ac9","Type":"ContainerStarted","Data":"3ed060b9ebef50d5a801ac9fc6d49765171782f816fb24e71f6c894d9441e7fb"} Sep 10 17:44:55.297533 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:44:55.297488 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8869546f6-52tgp" podStartSLOduration=2.297474737 podStartE2EDuration="2.297474737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:55.296800261 +0000 UTC m=+318.751386595" watchObservedRunningTime="2026-09-10 17:44:55.297474737 +0000 UTC m=+318.752061071" Sep 10 17:45:04.210639 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:04.210603 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:45:04.211044 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:04.210663 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:45:04.215463 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:04.215438 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:45:04.314321 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:04.314293 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:45:41.935380 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:41.935303 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc"] Sep 10 17:45:41.938441 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:41.938425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:41.940606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:41.940578 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:45:41.940606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:41.940597 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:45:41.940781 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:41.940763 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v4n7\"" Sep 10 17:45:41.948971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:41.948950 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc"] Sep 10 17:45:42.040977 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.040950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.041112 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.041020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9szc\" (UniqueName: \"kubernetes.io/projected/20fcb893-73f5-4558-a39c-216811c87437-kube-api-access-d9szc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.041112 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.041043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.142169 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.142123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9szc\" (UniqueName: \"kubernetes.io/projected/20fcb893-73f5-4558-a39c-216811c87437-kube-api-access-d9szc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.142169 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.142171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.142342 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.142283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.142621 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.142606 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.142660 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.142631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.149551 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.149529 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9szc\" (UniqueName: \"kubernetes.io/projected/20fcb893-73f5-4558-a39c-216811c87437-kube-api-access-d9szc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.246991 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.246918 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:42.512755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.512668 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc"] Sep 10 17:45:42.515687 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:45:42.515660 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fcb893_73f5_4558_a39c_216811c87437.slice/crio-b03a78303a312ed7a64764214775e51dd6970b76c5624c20e00bffac10b6391d WatchSource:0}: Error finding container b03a78303a312ed7a64764214775e51dd6970b76c5624c20e00bffac10b6391d: Status 404 returned error can't find the container with id b03a78303a312ed7a64764214775e51dd6970b76c5624c20e00bffac10b6391d Sep 10 17:45:42.518059 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:42.518039 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:45:43.444014 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:43.443966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" event={"ID":"20fcb893-73f5-4558-a39c-216811c87437","Type":"ContainerStarted","Data":"b03a78303a312ed7a64764214775e51dd6970b76c5624c20e00bffac10b6391d"} Sep 10 17:45:48.463921 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:48.463883 2580 generic.go:356] "Generic (PLEG): container finished" podID="20fcb893-73f5-4558-a39c-216811c87437" containerID="c71a09ba731e5501b153be624a4b6d4a6e83fc49f4c26c50cdafe77315622ab7" exitCode=0 Sep 10 17:45:48.464325 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:48.463971 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" event={"ID":"20fcb893-73f5-4558-a39c-216811c87437","Type":"ContainerDied","Data":"c71a09ba731e5501b153be624a4b6d4a6e83fc49f4c26c50cdafe77315622ab7"} Sep 10 17:45:51.477463 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:51.477428 2580 generic.go:356] "Generic (PLEG): container finished" podID="20fcb893-73f5-4558-a39c-216811c87437" containerID="daf817ba2559af3c700684edc8259614bb3c986f7226b29665e547cdea5f5ef7" exitCode=0 Sep 10 17:45:51.477878 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:51.477526 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" event={"ID":"20fcb893-73f5-4558-a39c-216811c87437","Type":"ContainerDied","Data":"daf817ba2559af3c700684edc8259614bb3c986f7226b29665e547cdea5f5ef7"} Sep 10 17:45:57.506597 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:57.506528 2580 generic.go:356] "Generic (PLEG): container finished" podID="20fcb893-73f5-4558-a39c-216811c87437" containerID="a2233d51b47275ff3d3725a6032348eff219b9a3661e656d931d7e172ca20242" exitCode=0 Sep 10 17:45:57.506963 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:57.506614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" event={"ID":"20fcb893-73f5-4558-a39c-216811c87437","Type":"ContainerDied","Data":"a2233d51b47275ff3d3725a6032348eff219b9a3661e656d931d7e172ca20242"} Sep 10 17:45:58.626293 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.626271 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:58.674521 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.674494 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9szc\" (UniqueName: \"kubernetes.io/projected/20fcb893-73f5-4558-a39c-216811c87437-kube-api-access-d9szc\") pod \"20fcb893-73f5-4558-a39c-216811c87437\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " Sep 10 17:45:58.674662 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.674535 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-bundle\") pod \"20fcb893-73f5-4558-a39c-216811c87437\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " Sep 10 17:45:58.674662 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.674555 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-util\") pod \"20fcb893-73f5-4558-a39c-216811c87437\" (UID: \"20fcb893-73f5-4558-a39c-216811c87437\") " Sep 10 17:45:58.675298 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.675269 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-bundle" (OuterVolumeSpecName: "bundle") pod "20fcb893-73f5-4558-a39c-216811c87437" (UID: "20fcb893-73f5-4558-a39c-216811c87437"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:45:58.676619 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.676595 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20fcb893-73f5-4558-a39c-216811c87437-kube-api-access-d9szc" (OuterVolumeSpecName: "kube-api-access-d9szc") pod "20fcb893-73f5-4558-a39c-216811c87437" (UID: "20fcb893-73f5-4558-a39c-216811c87437"). InnerVolumeSpecName "kube-api-access-d9szc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:45:58.679483 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.679461 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-util" (OuterVolumeSpecName: "util") pod "20fcb893-73f5-4558-a39c-216811c87437" (UID: "20fcb893-73f5-4558-a39c-216811c87437"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:45:58.775269 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.775209 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9szc\" (UniqueName: \"kubernetes.io/projected/20fcb893-73f5-4558-a39c-216811c87437-kube-api-access-d9szc\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:45:58.775269 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.775232 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:45:58.775269 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:58.775241 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20fcb893-73f5-4558-a39c-216811c87437-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:45:59.514526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:59.514495 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" event={"ID":"20fcb893-73f5-4558-a39c-216811c87437","Type":"ContainerDied","Data":"b03a78303a312ed7a64764214775e51dd6970b76c5624c20e00bffac10b6391d"} Sep 10 17:45:59.514526 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:59.514530 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smxkc" Sep 10 17:45:59.514711 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:45:59.514541 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b03a78303a312ed7a64764214775e51dd6970b76c5624c20e00bffac10b6391d" Sep 10 17:46:04.993506 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993473 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls"] Sep 10 17:46:04.993909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993696 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20fcb893-73f5-4558-a39c-216811c87437" containerName="extract" Sep 10 17:46:04.993909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993706 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="20fcb893-73f5-4558-a39c-216811c87437" containerName="extract" Sep 10 17:46:04.993909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993715 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20fcb893-73f5-4558-a39c-216811c87437" containerName="pull" Sep 10 17:46:04.993909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993721 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="20fcb893-73f5-4558-a39c-216811c87437" containerName="pull" Sep 10 17:46:04.993909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993731 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20fcb893-73f5-4558-a39c-216811c87437" containerName="util" Sep 10 17:46:04.993909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993736 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="20fcb893-73f5-4558-a39c-216811c87437" containerName="util" Sep 10 17:46:04.993909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:04.993783 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="20fcb893-73f5-4558-a39c-216811c87437" containerName="extract" Sep 10 17:46:05.044685 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.044650 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls"] Sep 10 17:46:05.044845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.044744 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.046967 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.046944 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 17:46:05.047208 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.047192 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jqw4x\"" Sep 10 17:46:05.047435 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.047420 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:46:05.129578 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.129552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78g66\" (UniqueName: \"kubernetes.io/projected/342d5964-bad0-41b4-8ca8-297d2c8ba715-kube-api-access-78g66\") pod \"cert-manager-operator-controller-manager-55c444bf86-46bls\" (UID: \"342d5964-bad0-41b4-8ca8-297d2c8ba715\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.129699 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.129618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342d5964-bad0-41b4-8ca8-297d2c8ba715-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-46bls\" (UID: \"342d5964-bad0-41b4-8ca8-297d2c8ba715\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.230272 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.230238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78g66\" (UniqueName: \"kubernetes.io/projected/342d5964-bad0-41b4-8ca8-297d2c8ba715-kube-api-access-78g66\") pod \"cert-manager-operator-controller-manager-55c444bf86-46bls\" (UID: \"342d5964-bad0-41b4-8ca8-297d2c8ba715\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.230393 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.230294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342d5964-bad0-41b4-8ca8-297d2c8ba715-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-46bls\" (UID: \"342d5964-bad0-41b4-8ca8-297d2c8ba715\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.230663 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.230647 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342d5964-bad0-41b4-8ca8-297d2c8ba715-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-46bls\" (UID: \"342d5964-bad0-41b4-8ca8-297d2c8ba715\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.238329 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.238305 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78g66\" (UniqueName: \"kubernetes.io/projected/342d5964-bad0-41b4-8ca8-297d2c8ba715-kube-api-access-78g66\") pod \"cert-manager-operator-controller-manager-55c444bf86-46bls\" (UID: \"342d5964-bad0-41b4-8ca8-297d2c8ba715\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.353005 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.352947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" Sep 10 17:46:05.649049 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:05.648971 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls"] Sep 10 17:46:05.652040 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:46:05.652012 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342d5964_bad0_41b4_8ca8_297d2c8ba715.slice/crio-ede04629203d8cb2edf3b0d623d7c5e03bd020a86ff877a40ca7eae98be40352 WatchSource:0}: Error finding container ede04629203d8cb2edf3b0d623d7c5e03bd020a86ff877a40ca7eae98be40352: Status 404 returned error can't find the container with id ede04629203d8cb2edf3b0d623d7c5e03bd020a86ff877a40ca7eae98be40352 Sep 10 17:46:06.542470 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:06.542436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" event={"ID":"342d5964-bad0-41b4-8ca8-297d2c8ba715","Type":"ContainerStarted","Data":"ede04629203d8cb2edf3b0d623d7c5e03bd020a86ff877a40ca7eae98be40352"} Sep 10 17:46:09.557514 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:09.557476 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" event={"ID":"342d5964-bad0-41b4-8ca8-297d2c8ba715","Type":"ContainerStarted","Data":"afdda269da9ba554ff489b7c4d37977ce436c5914a3211be7a074197fad4d5fc"} Sep 10 17:46:09.577308 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:09.577261 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46bls" podStartSLOduration=2.680027248 podStartE2EDuration="5.577245392s" totalImagesPullingTime="2.897218144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:09.576040917 +0000 UTC m=+393.030627250" watchObservedRunningTime="2026-09-10 17:46:09.577245392 +0000 UTC m=+393.031831726" Sep 10 17:46:10.260240 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.260205 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4"] Sep 10 17:46:10.284277 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.284252 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4"] Sep 10 17:46:10.284431 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.284354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.287038 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.287016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v4n7\"" Sep 10 17:46:10.287457 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.287438 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:46:10.287523 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.287473 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:46:10.373582 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.373547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.373749 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.373610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.373749 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.373668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzj2z\" (UniqueName: \"kubernetes.io/projected/c8768b3a-e330-40b6-b8c3-28f7adee5753-kube-api-access-mzj2z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.475008 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.474973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.475181 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.475055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.475181 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.475079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzj2z\" (UniqueName: \"kubernetes.io/projected/c8768b3a-e330-40b6-b8c3-28f7adee5753-kube-api-access-mzj2z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.475412 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.475394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.475449 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.475426 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.482555 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.482524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzj2z\" (UniqueName: \"kubernetes.io/projected/c8768b3a-e330-40b6-b8c3-28f7adee5753-kube-api-access-mzj2z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.593961 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.593882 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:10.890538 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:10.890507 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4"] Sep 10 17:46:10.893404 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:46:10.893374 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8768b3a_e330_40b6_b8c3_28f7adee5753.slice/crio-a133aac0add7ead0ce3e8fd96a9143bdb402b1cc729c23804b247b14ab85a3ab WatchSource:0}: Error finding container a133aac0add7ead0ce3e8fd96a9143bdb402b1cc729c23804b247b14ab85a3ab: Status 404 returned error can't find the container with id a133aac0add7ead0ce3e8fd96a9143bdb402b1cc729c23804b247b14ab85a3ab Sep 10 17:46:11.567515 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:11.567478 2580 generic.go:356] "Generic (PLEG): container finished" podID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerID="c1d6c103fc2b29b547a42e0300f0ff93ac36a5270ce6b0bebcbcb662da086d1b" exitCode=0 Sep 10 17:46:11.567684 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:11.567526 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" event={"ID":"c8768b3a-e330-40b6-b8c3-28f7adee5753","Type":"ContainerDied","Data":"c1d6c103fc2b29b547a42e0300f0ff93ac36a5270ce6b0bebcbcb662da086d1b"} Sep 10 17:46:11.567684 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:11.567561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" event={"ID":"c8768b3a-e330-40b6-b8c3-28f7adee5753","Type":"ContainerStarted","Data":"a133aac0add7ead0ce3e8fd96a9143bdb402b1cc729c23804b247b14ab85a3ab"} Sep 10 17:46:13.578938 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:13.578848 2580 generic.go:356] "Generic (PLEG): container finished" podID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerID="4a0cb44aa41fc7a23fafe4b508feec89aaf14494001b3a293b260507b66cca33" exitCode=0 Sep 10 17:46:13.579286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:13.578928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" event={"ID":"c8768b3a-e330-40b6-b8c3-28f7adee5753","Type":"ContainerDied","Data":"4a0cb44aa41fc7a23fafe4b508feec89aaf14494001b3a293b260507b66cca33"} Sep 10 17:46:14.584598 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:14.584566 2580 generic.go:356] "Generic (PLEG): container finished" podID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerID="633f95f912e18072a1ebbffade555fb8c152dc17a0148cab6347137c80606d69" exitCode=0 Sep 10 17:46:14.585009 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:14.584636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" event={"ID":"c8768b3a-e330-40b6-b8c3-28f7adee5753","Type":"ContainerDied","Data":"633f95f912e18072a1ebbffade555fb8c152dc17a0148cab6347137c80606d69"} Sep 10 17:46:15.712410 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.712387 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:15.821570 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.821539 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzj2z\" (UniqueName: \"kubernetes.io/projected/c8768b3a-e330-40b6-b8c3-28f7adee5753-kube-api-access-mzj2z\") pod \"c8768b3a-e330-40b6-b8c3-28f7adee5753\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " Sep 10 17:46:15.821755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.821628 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-util\") pod \"c8768b3a-e330-40b6-b8c3-28f7adee5753\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " Sep 10 17:46:15.821755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.821662 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-bundle\") pod \"c8768b3a-e330-40b6-b8c3-28f7adee5753\" (UID: \"c8768b3a-e330-40b6-b8c3-28f7adee5753\") " Sep 10 17:46:15.822111 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.822081 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-bundle" (OuterVolumeSpecName: "bundle") pod "c8768b3a-e330-40b6-b8c3-28f7adee5753" (UID: "c8768b3a-e330-40b6-b8c3-28f7adee5753"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:46:15.823632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.823604 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8768b3a-e330-40b6-b8c3-28f7adee5753-kube-api-access-mzj2z" (OuterVolumeSpecName: "kube-api-access-mzj2z") pod "c8768b3a-e330-40b6-b8c3-28f7adee5753" (UID: "c8768b3a-e330-40b6-b8c3-28f7adee5753"). InnerVolumeSpecName "kube-api-access-mzj2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:46:15.827338 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.827318 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-util" (OuterVolumeSpecName: "util") pod "c8768b3a-e330-40b6-b8c3-28f7adee5753" (UID: "c8768b3a-e330-40b6-b8c3-28f7adee5753"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:46:15.922826 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.922794 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:15.922966 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.922845 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8768b3a-e330-40b6-b8c3-28f7adee5753-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:15.922966 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:15.922860 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzj2z\" (UniqueName: \"kubernetes.io/projected/c8768b3a-e330-40b6-b8c3-28f7adee5753-kube-api-access-mzj2z\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:16.594671 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:16.594638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" event={"ID":"c8768b3a-e330-40b6-b8c3-28f7adee5753","Type":"ContainerDied","Data":"a133aac0add7ead0ce3e8fd96a9143bdb402b1cc729c23804b247b14ab85a3ab"} Sep 10 17:46:16.594671 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:16.594666 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fct5h4" Sep 10 17:46:16.594899 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:16.594688 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a133aac0add7ead0ce3e8fd96a9143bdb402b1cc729c23804b247b14ab85a3ab" Sep 10 17:46:30.007399 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007362 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl"] Sep 10 17:46:30.007894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007645 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerName="extract" Sep 10 17:46:30.007894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007660 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerName="extract" Sep 10 17:46:30.007894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007672 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerName="pull" Sep 10 17:46:30.007894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007677 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerName="pull" Sep 10 17:46:30.007894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007691 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerName="util" Sep 10 17:46:30.007894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007697 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerName="util" Sep 10 17:46:30.007894 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.007745 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8768b3a-e330-40b6-b8c3-28f7adee5753" containerName="extract" Sep 10 17:46:30.009681 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.009664 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.011558 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.011524 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:46:30.012211 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.012192 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v4n7\"" Sep 10 17:46:30.012211 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.012206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:46:30.018502 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.018479 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl"] Sep 10 17:46:30.042152 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.042120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.042275 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.042240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbhb7\" (UniqueName: \"kubernetes.io/projected/899b459c-4a4e-4ef8-8b81-550d344fb455-kube-api-access-wbhb7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.042329 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.042301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.142680 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.142636 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.142887 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.142692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.142887 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.142767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbhb7\" (UniqueName: \"kubernetes.io/projected/899b459c-4a4e-4ef8-8b81-550d344fb455-kube-api-access-wbhb7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.143049 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.143028 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.143095 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.143079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.153554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.153526 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbhb7\" (UniqueName: \"kubernetes.io/projected/899b459c-4a4e-4ef8-8b81-550d344fb455-kube-api-access-wbhb7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.319443 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.319357 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:30.592683 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.592659 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl"] Sep 10 17:46:30.595260 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:46:30.595231 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899b459c_4a4e_4ef8_8b81_550d344fb455.slice/crio-f4587a9860bb157cfe7246412b1d76b4cc68acdb84b4d5860f8c93e17429a471 WatchSource:0}: Error finding container f4587a9860bb157cfe7246412b1d76b4cc68acdb84b4d5860f8c93e17429a471: Status 404 returned error can't find the container with id f4587a9860bb157cfe7246412b1d76b4cc68acdb84b4d5860f8c93e17429a471 Sep 10 17:46:30.651723 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:30.651697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" event={"ID":"899b459c-4a4e-4ef8-8b81-550d344fb455","Type":"ContainerStarted","Data":"f4587a9860bb157cfe7246412b1d76b4cc68acdb84b4d5860f8c93e17429a471"} Sep 10 17:46:31.657746 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:31.657713 2580 generic.go:356] "Generic (PLEG): container finished" podID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerID="8bbbce03e9c566820cec69713feabc878b8b482eb5dcabceae613997188beee8" exitCode=0 Sep 10 17:46:31.658212 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:31.657762 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" event={"ID":"899b459c-4a4e-4ef8-8b81-550d344fb455","Type":"ContainerDied","Data":"8bbbce03e9c566820cec69713feabc878b8b482eb5dcabceae613997188beee8"} Sep 10 17:46:32.664400 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:32.664359 2580 generic.go:356] "Generic (PLEG): container finished" podID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerID="84200bad53ee6751fd8af0d1bd7a52ee4a39bb16cb820e8b403a08f9f78a4b63" exitCode=0 Sep 10 17:46:32.664804 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:32.664435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" event={"ID":"899b459c-4a4e-4ef8-8b81-550d344fb455","Type":"ContainerDied","Data":"84200bad53ee6751fd8af0d1bd7a52ee4a39bb16cb820e8b403a08f9f78a4b63"} Sep 10 17:46:33.671383 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:33.671346 2580 generic.go:356] "Generic (PLEG): container finished" podID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerID="2503e7a1e70b1a0f6dbd1a57e38764241b2e3951499ee18f1e7b30f80098cc9f" exitCode=0 Sep 10 17:46:33.671845 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:33.671390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" event={"ID":"899b459c-4a4e-4ef8-8b81-550d344fb455","Type":"ContainerDied","Data":"2503e7a1e70b1a0f6dbd1a57e38764241b2e3951499ee18f1e7b30f80098cc9f"} Sep 10 17:46:34.798959 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.798934 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:34.883691 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.883653 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-util\") pod \"899b459c-4a4e-4ef8-8b81-550d344fb455\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " Sep 10 17:46:34.883890 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.883708 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-bundle\") pod \"899b459c-4a4e-4ef8-8b81-550d344fb455\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " Sep 10 17:46:34.883890 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.883753 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbhb7\" (UniqueName: \"kubernetes.io/projected/899b459c-4a4e-4ef8-8b81-550d344fb455-kube-api-access-wbhb7\") pod \"899b459c-4a4e-4ef8-8b81-550d344fb455\" (UID: \"899b459c-4a4e-4ef8-8b81-550d344fb455\") " Sep 10 17:46:34.884443 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.884413 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-bundle" (OuterVolumeSpecName: "bundle") pod "899b459c-4a4e-4ef8-8b81-550d344fb455" (UID: "899b459c-4a4e-4ef8-8b81-550d344fb455"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:46:34.885782 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.885754 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899b459c-4a4e-4ef8-8b81-550d344fb455-kube-api-access-wbhb7" (OuterVolumeSpecName: "kube-api-access-wbhb7") pod "899b459c-4a4e-4ef8-8b81-550d344fb455" (UID: "899b459c-4a4e-4ef8-8b81-550d344fb455"). InnerVolumeSpecName "kube-api-access-wbhb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:46:34.889445 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.889424 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-util" (OuterVolumeSpecName: "util") pod "899b459c-4a4e-4ef8-8b81-550d344fb455" (UID: "899b459c-4a4e-4ef8-8b81-550d344fb455"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:46:34.984496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.984409 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbhb7\" (UniqueName: \"kubernetes.io/projected/899b459c-4a4e-4ef8-8b81-550d344fb455-kube-api-access-wbhb7\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:34.984496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.984438 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:34.984496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:34.984450 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899b459c-4a4e-4ef8-8b81-550d344fb455-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:35.681361 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:35.681328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" event={"ID":"899b459c-4a4e-4ef8-8b81-550d344fb455","Type":"ContainerDied","Data":"f4587a9860bb157cfe7246412b1d76b4cc68acdb84b4d5860f8c93e17429a471"} Sep 10 17:46:35.681361 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:35.681349 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4trvl" Sep 10 17:46:35.681562 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:35.681375 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4587a9860bb157cfe7246412b1d76b4cc68acdb84b4d5860f8c93e17429a471" Sep 10 17:46:47.291776 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.291741 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg"] Sep 10 17:46:47.292248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.292010 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerName="pull" Sep 10 17:46:47.292248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.292021 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerName="pull" Sep 10 17:46:47.292248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.292038 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerName="util" Sep 10 17:46:47.292248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.292043 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerName="util" Sep 10 17:46:47.292248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.292053 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerName="extract" Sep 10 17:46:47.292248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.292059 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerName="extract" Sep 10 17:46:47.292248 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.292107 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="899b459c-4a4e-4ef8-8b81-550d344fb455" containerName="extract" Sep 10 17:46:47.294722 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.294706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.300182 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.300154 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v4n7\"" Sep 10 17:46:47.300299 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.300157 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:46:47.300595 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.300578 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:46:47.316104 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.316080 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg"] Sep 10 17:46:47.388034 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.387994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.388211 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.388044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqmz\" (UniqueName: \"kubernetes.io/projected/f06fd7c9-75fc-4fb1-825e-46449bf6291b-kube-api-access-fgqmz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.388211 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.388142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.489188 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.489147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.489188 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.489203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.489426 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.489226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqmz\" (UniqueName: \"kubernetes.io/projected/f06fd7c9-75fc-4fb1-825e-46449bf6291b-kube-api-access-fgqmz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.489578 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.489557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.489578 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.489572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.511544 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.511512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqmz\" (UniqueName: \"kubernetes.io/projected/f06fd7c9-75fc-4fb1-825e-46449bf6291b-kube-api-access-fgqmz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.603470 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.603387 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:47.631282 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.631252 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4"] Sep 10 17:46:47.636344 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.636322 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.638615 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.638592 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 17:46:47.638774 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.638624 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 17:46:47.638957 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.638934 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qkbhg\"" Sep 10 17:46:47.639041 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.639023 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 17:46:47.639041 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.639033 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 17:46:47.658684 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.658658 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4"] Sep 10 17:46:47.691711 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.691679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6aad801e-dc5d-4022-88d9-acd5bcaccd06-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.691902 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.691727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aad801e-dc5d-4022-88d9-acd5bcaccd06-tmp\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.691902 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.691754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vswbb\" (UniqueName: \"kubernetes.io/projected/6aad801e-dc5d-4022-88d9-acd5bcaccd06-kube-api-access-vswbb\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.691902 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.691811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6aad801e-dc5d-4022-88d9-acd5bcaccd06-manifests\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.691902 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.691856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6aad801e-dc5d-4022-88d9-acd5bcaccd06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.792370 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.792333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6aad801e-dc5d-4022-88d9-acd5bcaccd06-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.792370 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.792380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aad801e-dc5d-4022-88d9-acd5bcaccd06-tmp\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.792632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.792400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vswbb\" (UniqueName: \"kubernetes.io/projected/6aad801e-dc5d-4022-88d9-acd5bcaccd06-kube-api-access-vswbb\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.792632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.792433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6aad801e-dc5d-4022-88d9-acd5bcaccd06-manifests\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.792632 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.792458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6aad801e-dc5d-4022-88d9-acd5bcaccd06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.792924 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.792896 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6aad801e-dc5d-4022-88d9-acd5bcaccd06-manifests\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.794844 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.794796 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aad801e-dc5d-4022-88d9-acd5bcaccd06-tmp\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.795191 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.795169 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6aad801e-dc5d-4022-88d9-acd5bcaccd06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.795232 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.795179 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6aad801e-dc5d-4022-88d9-acd5bcaccd06-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.802093 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.802072 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vswbb\" (UniqueName: \"kubernetes.io/projected/6aad801e-dc5d-4022-88d9-acd5bcaccd06-kube-api-access-vswbb\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4\" (UID: \"6aad801e-dc5d-4022-88d9-acd5bcaccd06\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:47.886053 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.886017 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg"] Sep 10 17:46:47.889410 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:46:47.889382 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06fd7c9_75fc_4fb1_825e_46449bf6291b.slice/crio-235a495d25a6d2e77c9fee2302635d8ee9ee788e1fcae1276e2ddfe2afc706bd WatchSource:0}: Error finding container 235a495d25a6d2e77c9fee2302635d8ee9ee788e1fcae1276e2ddfe2afc706bd: Status 404 returned error can't find the container with id 235a495d25a6d2e77c9fee2302635d8ee9ee788e1fcae1276e2ddfe2afc706bd Sep 10 17:46:47.947302 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:47.947281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:48.272687 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:48.272664 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4"] Sep 10 17:46:48.275116 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:46:48.275082 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aad801e_dc5d_4022_88d9_acd5bcaccd06.slice/crio-2879ab316def309f4bd6f401b689500927429259dc3d45f8a20329782a4fbd12 WatchSource:0}: Error finding container 2879ab316def309f4bd6f401b689500927429259dc3d45f8a20329782a4fbd12: Status 404 returned error can't find the container with id 2879ab316def309f4bd6f401b689500927429259dc3d45f8a20329782a4fbd12 Sep 10 17:46:48.741709 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:48.741666 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" event={"ID":"6aad801e-dc5d-4022-88d9-acd5bcaccd06","Type":"ContainerStarted","Data":"2879ab316def309f4bd6f401b689500927429259dc3d45f8a20329782a4fbd12"} Sep 10 17:46:48.743677 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:48.743640 2580 generic.go:356] "Generic (PLEG): container finished" podID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerID="3338280e4ca2a72b493c4d24ac0d1d951cbb505cf0b8c36bba602b030d12b58c" exitCode=0 Sep 10 17:46:48.743807 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:48.743711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" event={"ID":"f06fd7c9-75fc-4fb1-825e-46449bf6291b","Type":"ContainerDied","Data":"3338280e4ca2a72b493c4d24ac0d1d951cbb505cf0b8c36bba602b030d12b58c"} Sep 10 17:46:48.743807 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:48.743751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" event={"ID":"f06fd7c9-75fc-4fb1-825e-46449bf6291b","Type":"ContainerStarted","Data":"235a495d25a6d2e77c9fee2302635d8ee9ee788e1fcae1276e2ddfe2afc706bd"} Sep 10 17:46:49.751908 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:49.751862 2580 generic.go:356] "Generic (PLEG): container finished" podID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerID="4fafee4bc51831859a0e52012319a9b42825f34741640a442810f5f0d98a4f6e" exitCode=0 Sep 10 17:46:49.752372 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:49.751968 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" event={"ID":"f06fd7c9-75fc-4fb1-825e-46449bf6291b","Type":"ContainerDied","Data":"4fafee4bc51831859a0e52012319a9b42825f34741640a442810f5f0d98a4f6e"} Sep 10 17:46:51.767264 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:51.767230 2580 generic.go:356] "Generic (PLEG): container finished" podID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerID="1c37ea8682485754397b7ade4bd65ed809ecc5bc72981c399ff804ea0944cce1" exitCode=0 Sep 10 17:46:51.767772 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:51.767328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" event={"ID":"f06fd7c9-75fc-4fb1-825e-46449bf6291b","Type":"ContainerDied","Data":"1c37ea8682485754397b7ade4bd65ed809ecc5bc72981c399ff804ea0944cce1"} Sep 10 17:46:51.768884 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:51.768859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" event={"ID":"6aad801e-dc5d-4022-88d9-acd5bcaccd06","Type":"ContainerStarted","Data":"086ea2dc2fa89d4a956cfb88ac4000093dbf3bf40b03f75918299e5c3aa51d98"} Sep 10 17:46:52.775736 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:52.775696 2580 generic.go:356] "Generic (PLEG): container finished" podID="6aad801e-dc5d-4022-88d9-acd5bcaccd06" containerID="086ea2dc2fa89d4a956cfb88ac4000093dbf3bf40b03f75918299e5c3aa51d98" exitCode=0 Sep 10 17:46:52.776201 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:52.775779 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" event={"ID":"6aad801e-dc5d-4022-88d9-acd5bcaccd06","Type":"ContainerDied","Data":"086ea2dc2fa89d4a956cfb88ac4000093dbf3bf40b03f75918299e5c3aa51d98"} Sep 10 17:46:52.899340 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:52.899314 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:53.035518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.035434 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-bundle\") pod \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " Sep 10 17:46:53.035518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.035486 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgqmz\" (UniqueName: \"kubernetes.io/projected/f06fd7c9-75fc-4fb1-825e-46449bf6291b-kube-api-access-fgqmz\") pod \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " Sep 10 17:46:53.035740 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.035527 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-util\") pod \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\" (UID: \"f06fd7c9-75fc-4fb1-825e-46449bf6291b\") " Sep 10 17:46:53.036233 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.036201 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-bundle" (OuterVolumeSpecName: "bundle") pod "f06fd7c9-75fc-4fb1-825e-46449bf6291b" (UID: "f06fd7c9-75fc-4fb1-825e-46449bf6291b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:46:53.037547 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.037518 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06fd7c9-75fc-4fb1-825e-46449bf6291b-kube-api-access-fgqmz" (OuterVolumeSpecName: "kube-api-access-fgqmz") pod "f06fd7c9-75fc-4fb1-825e-46449bf6291b" (UID: "f06fd7c9-75fc-4fb1-825e-46449bf6291b"). InnerVolumeSpecName "kube-api-access-fgqmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:46:53.040995 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.040959 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-util" (OuterVolumeSpecName: "util") pod "f06fd7c9-75fc-4fb1-825e-46449bf6291b" (UID: "f06fd7c9-75fc-4fb1-825e-46449bf6291b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:46:53.136444 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.136417 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:53.136529 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.136466 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f06fd7c9-75fc-4fb1-825e-46449bf6291b-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:53.136529 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.136477 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgqmz\" (UniqueName: \"kubernetes.io/projected/f06fd7c9-75fc-4fb1-825e-46449bf6291b-kube-api-access-fgqmz\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:46:53.782113 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.782083 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" Sep 10 17:46:53.782113 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.782092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0t7bgg" event={"ID":"f06fd7c9-75fc-4fb1-825e-46449bf6291b","Type":"ContainerDied","Data":"235a495d25a6d2e77c9fee2302635d8ee9ee788e1fcae1276e2ddfe2afc706bd"} Sep 10 17:46:53.782578 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.782139 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="235a495d25a6d2e77c9fee2302635d8ee9ee788e1fcae1276e2ddfe2afc706bd" Sep 10 17:46:53.784130 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.784105 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" event={"ID":"6aad801e-dc5d-4022-88d9-acd5bcaccd06","Type":"ContainerStarted","Data":"3e94c331555355eb866c9cfc9547d61bd63e707f0bc7b702d384bb3809fe6e83"} Sep 10 17:46:53.784229 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.784173 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:46:53.813523 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:46:53.813452 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" podStartSLOduration=2.568964658 podStartE2EDuration="6.813432603s" totalImagesPullingTime="3.128728707s" totalInitContainerRuntime="1.115739238s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:53.811641529 +0000 UTC m=+437.266227877" watchObservedRunningTime="2026-09-10 17:46:53.813432603 +0000 UTC m=+437.268018940" Sep 10 17:47:04.791797 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:04.791719 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4" Sep 10 17:47:07.289715 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.289678 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78"] Sep 10 17:47:07.290119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.289990 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerName="extract" Sep 10 17:47:07.290119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.290002 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerName="extract" Sep 10 17:47:07.290119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.290023 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerName="pull" Sep 10 17:47:07.290119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.290030 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerName="pull" Sep 10 17:47:07.290119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.290038 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerName="util" Sep 10 17:47:07.290119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.290043 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerName="util" Sep 10 17:47:07.290119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.290095 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06fd7c9-75fc-4fb1-825e-46449bf6291b" containerName="extract" Sep 10 17:47:07.292899 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.292879 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.297750 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.297728 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 17:47:07.297967 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.297949 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 17:47:07.302314 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.302294 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xjznp\"" Sep 10 17:47:07.321213 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.321176 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78"] Sep 10 17:47:07.448312 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.448276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8b003c1-846d-4c6b-92d4-e742e541bf45-tmp\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.448499 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.448334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b003c1-846d-4c6b-92d4-e742e541bf45-tls-certs\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.448499 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.448409 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5g5\" (UniqueName: \"kubernetes.io/projected/a8b003c1-846d-4c6b-92d4-e742e541bf45-kube-api-access-pg5g5\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.549689 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.549589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8b003c1-846d-4c6b-92d4-e742e541bf45-tmp\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.549689 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.549656 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b003c1-846d-4c6b-92d4-e742e541bf45-tls-certs\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.549964 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.549710 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5g5\" (UniqueName: \"kubernetes.io/projected/a8b003c1-846d-4c6b-92d4-e742e541bf45-kube-api-access-pg5g5\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.551936 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.551912 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8b003c1-846d-4c6b-92d4-e742e541bf45-tmp\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.552152 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.552132 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b003c1-846d-4c6b-92d4-e742e541bf45-tls-certs\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.578261 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.578233 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5g5\" (UniqueName: \"kubernetes.io/projected/a8b003c1-846d-4c6b-92d4-e742e541bf45-kube-api-access-pg5g5\") pod \"kube-auth-proxy-6f88844dfb-xnx78\" (UID: \"a8b003c1-846d-4c6b-92d4-e742e541bf45\") " pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.602241 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.602212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" Sep 10 17:47:07.880086 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:07.880054 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78"] Sep 10 17:47:07.886719 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:47:07.886691 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b003c1_846d_4c6b_92d4_e742e541bf45.slice/crio-c75b76a3d6b39be46c0dd5280958e80f65bb4d300fc7366b6ae9152a64c70134 WatchSource:0}: Error finding container c75b76a3d6b39be46c0dd5280958e80f65bb4d300fc7366b6ae9152a64c70134: Status 404 returned error can't find the container with id c75b76a3d6b39be46c0dd5280958e80f65bb4d300fc7366b6ae9152a64c70134 Sep 10 17:47:08.852513 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:08.852473 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" event={"ID":"a8b003c1-846d-4c6b-92d4-e742e541bf45","Type":"ContainerStarted","Data":"c75b76a3d6b39be46c0dd5280958e80f65bb4d300fc7366b6ae9152a64c70134"} Sep 10 17:47:10.862763 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:10.862670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" event={"ID":"a8b003c1-846d-4c6b-92d4-e742e541bf45","Type":"ContainerStarted","Data":"f694c8e1c776df2f9744c8a14718a23ff30de5487d95cd27a20e40b274f2ee67"} Sep 10 17:47:10.890294 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:10.890236 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f88844dfb-xnx78" podStartSLOduration=1.296805363 podStartE2EDuration="3.890221634s" totalImagesPullingTime="2.593416271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:10.889765044 +0000 UTC m=+454.344351379" watchObservedRunningTime="2026-09-10 17:47:10.890221634 +0000 UTC m=+454.344807968" Sep 10 17:47:14.121144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.121107 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8"] Sep 10 17:47:14.124954 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.124936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.127198 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.127176 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wzlh9\"" Sep 10 17:47:14.127460 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.127443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 17:47:14.141565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.141496 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8"] Sep 10 17:47:14.205694 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc9mp\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-kube-api-access-gc9mp\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.205694 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.205949 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.205949 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.205949 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.205949 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.205949 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.205949 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.206200 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.205962 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.215219 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.215191 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5"] Sep 10 17:47:14.218442 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.218413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.243666 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.243638 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5"] Sep 10 17:47:14.306872 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.306832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307048 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.306887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307048 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.306913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307048 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.306930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307048 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.306984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307048 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307048 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307324 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307324 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307324 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc9mp\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-kube-api-access-gc9mp\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307324 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307264 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307324 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307346 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrtqv\" (UniqueName: \"kubernetes.io/projected/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-kube-api-access-wrtqv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307393 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307565 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.307902 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.307653 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.308129 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.308108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.309445 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.309428 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.309520 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.309503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.318835 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.318798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc9mp\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-kube-api-access-gc9mp\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.319338 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.319319 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckc9b8\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.407994 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.407906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.407994 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.407949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.407994 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.407970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.407994 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.407996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtqv\" (UniqueName: \"kubernetes.io/projected/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-kube-api-access-wrtqv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408465 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408465 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408412 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408465 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408618 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408618 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.408905 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.408884 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.410426 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.410407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.410505 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.410446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.417468 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.417439 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtqv\" (UniqueName: \"kubernetes.io/projected/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-kube-api-access-wrtqv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.418542 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.418523 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3e7f3f-4b2b-471b-a3e8-c3edcb100555-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5\" (UID: \"df3e7f3f-4b2b-471b-a3e8-c3edcb100555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.434238 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.434214 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:14.528361 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.528327 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:14.724233 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.724208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8"] Sep 10 17:47:14.726687 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:47:14.726664 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc36fdf0_f238_44a5_af4a_d1644254a6a9.slice/crio-2545e2c24438b48a1d90b45a9d7ee0a5e2194c7614d12e927f4b55c84fdfe9e6 WatchSource:0}: Error finding container 2545e2c24438b48a1d90b45a9d7ee0a5e2194c7614d12e927f4b55c84fdfe9e6: Status 404 returned error can't find the container with id 2545e2c24438b48a1d90b45a9d7ee0a5e2194c7614d12e927f4b55c84fdfe9e6 Sep 10 17:47:14.824122 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.824086 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5"] Sep 10 17:47:14.827754 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:47:14.827727 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3e7f3f_4b2b_471b_a3e8_c3edcb100555.slice/crio-3e2d2f622bc9d337143e573b0e5e45f19e692d4f157ec6bf053867ff52df3f7e WatchSource:0}: Error finding container 3e2d2f622bc9d337143e573b0e5e45f19e692d4f157ec6bf053867ff52df3f7e: Status 404 returned error can't find the container with id 3e2d2f622bc9d337143e573b0e5e45f19e692d4f157ec6bf053867ff52df3f7e Sep 10 17:47:14.882485 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.882444 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" event={"ID":"df3e7f3f-4b2b-471b-a3e8-c3edcb100555","Type":"ContainerStarted","Data":"3e2d2f622bc9d337143e573b0e5e45f19e692d4f157ec6bf053867ff52df3f7e"} Sep 10 17:47:14.883727 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:14.883702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" event={"ID":"bc36fdf0-f238-44a5-af4a-d1644254a6a9","Type":"ContainerStarted","Data":"2545e2c24438b48a1d90b45a9d7ee0a5e2194c7614d12e927f4b55c84fdfe9e6"} Sep 10 17:47:15.736212 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.736174 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw"] Sep 10 17:47:15.740249 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.739623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.742628 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.742600 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 17:47:15.742866 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.742849 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:47:15.743401 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.743375 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 17:47:15.743401 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.743393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 17:47:15.743739 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.743640 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 17:47:15.743857 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.743839 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b42sc\"" Sep 10 17:47:15.754023 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.753995 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw"] Sep 10 17:47:15.822107 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.822070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n96r\" (UniqueName: \"kubernetes.io/projected/15052c22-b55c-4f8e-bf38-aa8df7952aaa-kube-api-access-8n96r\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.822303 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.822182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15052c22-b55c-4f8e-bf38-aa8df7952aaa-cert\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.822303 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.822244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15052c22-b55c-4f8e-bf38-aa8df7952aaa-metrics-cert\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.822303 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.822274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15052c22-b55c-4f8e-bf38-aa8df7952aaa-manager-config\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.923645 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.923605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15052c22-b55c-4f8e-bf38-aa8df7952aaa-metrics-cert\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.923854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.923658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15052c22-b55c-4f8e-bf38-aa8df7952aaa-manager-config\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.923854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.923754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n96r\" (UniqueName: \"kubernetes.io/projected/15052c22-b55c-4f8e-bf38-aa8df7952aaa-kube-api-access-8n96r\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.923854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.923805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15052c22-b55c-4f8e-bf38-aa8df7952aaa-cert\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.924806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.924740 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15052c22-b55c-4f8e-bf38-aa8df7952aaa-manager-config\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.927422 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.927394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15052c22-b55c-4f8e-bf38-aa8df7952aaa-metrics-cert\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.927568 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.927510 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15052c22-b55c-4f8e-bf38-aa8df7952aaa-cert\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:15.933309 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:15.933252 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n96r\" (UniqueName: \"kubernetes.io/projected/15052c22-b55c-4f8e-bf38-aa8df7952aaa-kube-api-access-8n96r\") pod \"lws-controller-manager-6b786784bd-7nsdw\" (UID: \"15052c22-b55c-4f8e-bf38-aa8df7952aaa\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:16.055147 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:16.054945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:16.346566 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:16.346127 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw"] Sep 10 17:47:17.261557 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:47:17.261521 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15052c22_b55c_4f8e_bf38_aa8df7952aaa.slice/crio-976626635a726c58b95663ced8849647deec8f76937d4111dc2558438b8932c7 WatchSource:0}: Error finding container 976626635a726c58b95663ced8849647deec8f76937d4111dc2558438b8932c7: Status 404 returned error can't find the container with id 976626635a726c58b95663ced8849647deec8f76937d4111dc2558438b8932c7 Sep 10 17:47:17.338738 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.338697 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:47:17.338889 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.338775 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:47:17.338889 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.338804 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:47:17.349245 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.349213 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:47:17.349339 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.349293 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:47:17.349420 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.349339 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:47:17.903072 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.903029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" event={"ID":"15052c22-b55c-4f8e-bf38-aa8df7952aaa","Type":"ContainerStarted","Data":"976626635a726c58b95663ced8849647deec8f76937d4111dc2558438b8932c7"} Sep 10 17:47:17.905087 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.905051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" event={"ID":"df3e7f3f-4b2b-471b-a3e8-c3edcb100555","Type":"ContainerStarted","Data":"086c7c14d30c7b221f2695957cc365fd636fb1572cc9b8e1464b1124b7962dda"} Sep 10 17:47:17.906793 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.906768 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" event={"ID":"bc36fdf0-f238-44a5-af4a-d1644254a6a9","Type":"ContainerStarted","Data":"01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c"} Sep 10 17:47:17.932667 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.932605 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" podStartSLOduration=1.423907304 podStartE2EDuration="3.932588483s" totalImagesPullingTime="2.508681179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:17.931956417 +0000 UTC m=+461.386542765" watchObservedRunningTime="2026-09-10 17:47:17.932588483 +0000 UTC m=+461.387174820" Sep 10 17:47:17.959326 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:17.959270 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" podStartSLOduration=1.338842793 podStartE2EDuration="3.959254643s" totalImagesPullingTime="2.62041185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:17.957387542 +0000 UTC m=+461.411973879" watchObservedRunningTime="2026-09-10 17:47:17.959254643 +0000 UTC m=+461.413840978" Sep 10 17:47:18.434443 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.434394 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:18.436101 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.436057 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Sep 10 17:47:18.436218 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.436117 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Sep 10 17:47:18.528893 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.528856 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:18.534559 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.534533 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:18.913474 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.913437 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" event={"ID":"15052c22-b55c-4f8e-bf38-aa8df7952aaa","Type":"ContainerStarted","Data":"c1e766aa8ffe2d967202892d94b751b6d4fcc555c050dd90062fd192ff7015c9"} Sep 10 17:47:18.913962 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.913943 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:18.914998 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.914974 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5" Sep 10 17:47:18.932699 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.932643 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" podStartSLOduration=2.523069451 podStartE2EDuration="3.932627269s" totalImagesPullingTime="1.409557818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:18.931249613 +0000 UTC m=+462.385835949" watchObservedRunningTime="2026-09-10 17:47:18.932627269 +0000 UTC m=+462.387213605" Sep 10 17:47:18.981772 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:18.981680 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8"] Sep 10 17:47:19.435414 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:19.435378 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Sep 10 17:47:19.435799 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:19.435436 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Sep 10 17:47:19.924335 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:19.924294 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:20.434956 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:20.434914 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Sep 10 17:47:20.435137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:20.434976 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Sep 10 17:47:20.928975 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:20.928914 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerName="istio-proxy" containerID="cri-o://01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c" gracePeriod=30 Sep 10 17:47:26.163881 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.163858 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:26.218364 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218300 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-socket\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218501 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218367 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-certs\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218501 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218408 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-credential-socket\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218501 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218450 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-envoy\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218501 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218479 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-data\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218710 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218508 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-token\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218710 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218560 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istiod-ca-cert\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218710 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218590 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc9mp\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-kube-api-access-gc9mp\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218710 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218600 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:47:26.218710 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218614 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-podinfo\") pod \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\" (UID: \"bc36fdf0-f238-44a5-af4a-d1644254a6a9\") " Sep 10 17:47:26.218971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218733 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:47:26.218971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218750 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:47:26.218971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218805 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:47:26.219102 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.218982 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-socket\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.219102 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.219003 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-workload-certs\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.219102 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.219018 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-credential-socket\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.219102 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.219031 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-data\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.219304 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.219122 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:47:26.220706 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.220676 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:47:26.220851 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.220803 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:47:26.220964 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.220945 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-kube-api-access-gc9mp" (OuterVolumeSpecName: "kube-api-access-gc9mp") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "kube-api-access-gc9mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:47:26.221213 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.221198 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc36fdf0-f238-44a5-af4a-d1644254a6a9" (UID: "bc36fdf0-f238-44a5-af4a-d1644254a6a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:47:26.319751 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.319722 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-token\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.319751 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.319746 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istiod-ca-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.319751 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.319757 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc9mp\" (UniqueName: \"kubernetes.io/projected/bc36fdf0-f238-44a5-af4a-d1644254a6a9-kube-api-access-gc9mp\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.319967 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.319766 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-podinfo\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.319967 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.319775 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc36fdf0-f238-44a5-af4a-d1644254a6a9-istio-envoy\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:47:26.958922 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.958885 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerID="01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c" exitCode=0 Sep 10 17:47:26.959093 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.958921 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" Sep 10 17:47:26.959093 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.958964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" event={"ID":"bc36fdf0-f238-44a5-af4a-d1644254a6a9","Type":"ContainerDied","Data":"01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c"} Sep 10 17:47:26.959093 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.959047 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8" event={"ID":"bc36fdf0-f238-44a5-af4a-d1644254a6a9","Type":"ContainerDied","Data":"2545e2c24438b48a1d90b45a9d7ee0a5e2194c7614d12e927f4b55c84fdfe9e6"} Sep 10 17:47:26.959093 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.959074 2580 scope.go:117] "RemoveContainer" containerID="01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c" Sep 10 17:47:26.967569 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.967552 2580 scope.go:117] "RemoveContainer" containerID="01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c" Sep 10 17:47:26.967851 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:47:26.967804 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c\": container with ID starting with 01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c not found: ID does not exist" containerID="01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c" Sep 10 17:47:26.967946 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:26.967859 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c"} err="failed to get container status \"01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c\": rpc error: code = NotFound desc = could not find container \"01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c\": container with ID starting with 01bdff617f0657a4c1e1434490c9f9cd34dd9ec6790dbaa2ed306875d3bf865c not found: ID does not exist" Sep 10 17:47:27.032539 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:27.032508 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8"] Sep 10 17:47:27.048239 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:27.048215 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckc9b8"] Sep 10 17:47:28.994510 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:28.994466 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" path="/var/lib/kubelet/pods/bc36fdf0-f238-44a5-af4a-d1644254a6a9/volumes" Sep 10 17:47:30.930625 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:30.930595 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-7nsdw" Sep 10 17:47:47.520466 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:47:47.520428 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8869546f6-52tgp"] Sep 10 17:48:12.541037 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.540975 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8869546f6-52tgp" podUID="03b99272-19b2-4925-895b-c93bbc879ac9" containerName="console" containerID="cri-o://e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a" gracePeriod=15 Sep 10 17:48:12.779913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.779887 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:48:12.894411 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894383 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-trusted-ca-bundle\") pod \"03b99272-19b2-4925-895b-c93bbc879ac9\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " Sep 10 17:48:12.894554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894416 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-service-ca\") pod \"03b99272-19b2-4925-895b-c93bbc879ac9\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " Sep 10 17:48:12.894554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894459 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-oauth-config\") pod \"03b99272-19b2-4925-895b-c93bbc879ac9\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " Sep 10 17:48:12.894554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894488 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d88vq\" (UniqueName: \"kubernetes.io/projected/03b99272-19b2-4925-895b-c93bbc879ac9-kube-api-access-d88vq\") pod \"03b99272-19b2-4925-895b-c93bbc879ac9\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " Sep 10 17:48:12.894554 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894509 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-serving-cert\") pod \"03b99272-19b2-4925-895b-c93bbc879ac9\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " Sep 10 17:48:12.894775 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894621 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-console-config\") pod \"03b99272-19b2-4925-895b-c93bbc879ac9\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " Sep 10 17:48:12.894775 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894679 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-oauth-serving-cert\") pod \"03b99272-19b2-4925-895b-c93bbc879ac9\" (UID: \"03b99272-19b2-4925-895b-c93bbc879ac9\") " Sep 10 17:48:12.894903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894841 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03b99272-19b2-4925-895b-c93bbc879ac9" (UID: "03b99272-19b2-4925-895b-c93bbc879ac9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:12.894983 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894957 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-service-ca" (OuterVolumeSpecName: "service-ca") pod "03b99272-19b2-4925-895b-c93bbc879ac9" (UID: "03b99272-19b2-4925-895b-c93bbc879ac9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:12.895039 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.894984 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-trusted-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:12.895084 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.895038 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-console-config" (OuterVolumeSpecName: "console-config") pod "03b99272-19b2-4925-895b-c93bbc879ac9" (UID: "03b99272-19b2-4925-895b-c93bbc879ac9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:12.895219 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.895198 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03b99272-19b2-4925-895b-c93bbc879ac9" (UID: "03b99272-19b2-4925-895b-c93bbc879ac9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:12.896612 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.896593 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03b99272-19b2-4925-895b-c93bbc879ac9" (UID: "03b99272-19b2-4925-895b-c93bbc879ac9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:48:12.897099 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.897077 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b99272-19b2-4925-895b-c93bbc879ac9-kube-api-access-d88vq" (OuterVolumeSpecName: "kube-api-access-d88vq") pod "03b99272-19b2-4925-895b-c93bbc879ac9" (UID: "03b99272-19b2-4925-895b-c93bbc879ac9"). InnerVolumeSpecName "kube-api-access-d88vq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:12.897099 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.897078 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03b99272-19b2-4925-895b-c93bbc879ac9" (UID: "03b99272-19b2-4925-895b-c93bbc879ac9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:48:12.995640 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.995612 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d88vq\" (UniqueName: \"kubernetes.io/projected/03b99272-19b2-4925-895b-c93bbc879ac9-kube-api-access-d88vq\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:12.995640 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.995635 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-serving-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:12.995640 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.995645 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-console-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:12.995872 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.995653 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-oauth-serving-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:12.995872 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.995663 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03b99272-19b2-4925-895b-c93bbc879ac9-service-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:12.995872 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:12.995672 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03b99272-19b2-4925-895b-c93bbc879ac9-console-oauth-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:13.158271 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.158186 2580 generic.go:356] "Generic (PLEG): container finished" podID="03b99272-19b2-4925-895b-c93bbc879ac9" containerID="e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a" exitCode=0 Sep 10 17:48:13.158271 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.158233 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8869546f6-52tgp" Sep 10 17:48:13.158456 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.158285 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8869546f6-52tgp" event={"ID":"03b99272-19b2-4925-895b-c93bbc879ac9","Type":"ContainerDied","Data":"e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a"} Sep 10 17:48:13.158456 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.158334 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8869546f6-52tgp" event={"ID":"03b99272-19b2-4925-895b-c93bbc879ac9","Type":"ContainerDied","Data":"3ed060b9ebef50d5a801ac9fc6d49765171782f816fb24e71f6c894d9441e7fb"} Sep 10 17:48:13.158456 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.158357 2580 scope.go:117] "RemoveContainer" containerID="e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a" Sep 10 17:48:13.170107 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.170089 2580 scope.go:117] "RemoveContainer" containerID="e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a" Sep 10 17:48:13.170411 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:48:13.170392 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a\": container with ID starting with e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a not found: ID does not exist" containerID="e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a" Sep 10 17:48:13.170478 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.170418 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a"} err="failed to get container status \"e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a\": rpc error: code = NotFound desc = could not find container \"e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a\": container with ID starting with e3e86106febccade8cebe8e61dbd1bd1b7e3430ef0284ecce4e33df0019b2b7a not found: ID does not exist" Sep 10 17:48:13.174028 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.174006 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8869546f6-52tgp"] Sep 10 17:48:13.180336 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:13.180303 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8869546f6-52tgp"] Sep 10 17:48:14.994328 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:14.994289 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b99272-19b2-4925-895b-c93bbc879ac9" path="/var/lib/kubelet/pods/03b99272-19b2-4925-895b-c93bbc879ac9/volumes" Sep 10 17:48:34.892108 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.892025 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh"] Sep 10 17:48:34.892719 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.892355 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerName="istio-proxy" Sep 10 17:48:34.892719 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.892368 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerName="istio-proxy" Sep 10 17:48:34.892719 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.892378 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b99272-19b2-4925-895b-c93bbc879ac9" containerName="console" Sep 10 17:48:34.892719 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.892384 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b99272-19b2-4925-895b-c93bbc879ac9" containerName="console" Sep 10 17:48:34.892719 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.892435 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b99272-19b2-4925-895b-c93bbc879ac9" containerName="console" Sep 10 17:48:34.892719 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.892443 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc36fdf0-f238-44a5-af4a-d1644254a6a9" containerName="istio-proxy" Sep 10 17:48:34.899047 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.899016 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:34.901674 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.901647 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:48:34.901903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.901885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v4n7\"" Sep 10 17:48:34.902241 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.902229 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:48:34.907965 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.907946 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh"] Sep 10 17:48:34.955675 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.955643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:34.955791 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.955679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:34.955791 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.955705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dqld\" (UniqueName: \"kubernetes.io/projected/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-kube-api-access-6dqld\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:34.995578 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.995556 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp"] Sep 10 17:48:34.998596 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:34.998580 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.016585 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.016562 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp"] Sep 10 17:48:35.056206 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.056335 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:35.056335 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:35.056335 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dqld\" (UniqueName: \"kubernetes.io/projected/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-kube-api-access-6dqld\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:35.056335 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.056335 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hwg\" (UniqueName: \"kubernetes.io/projected/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-kube-api-access-d7hwg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.056597 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056539 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:35.056652 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.056601 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:35.067188 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.067159 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dqld\" (UniqueName: \"kubernetes.io/projected/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-kube-api-access-6dqld\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:35.157361 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.157293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.157361 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.157344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.157529 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.157399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hwg\" (UniqueName: \"kubernetes.io/projected/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-kube-api-access-d7hwg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.157699 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.157676 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.157699 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.157689 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.172777 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.172756 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c"] Sep 10 17:48:35.174719 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.174699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hwg\" (UniqueName: \"kubernetes.io/projected/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-kube-api-access-d7hwg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.176136 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.176122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.179569 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:48:35.179541 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.193128 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.193109 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c"] Sep 10 17:48:35.208390 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.208369 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:35.245921 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.245895 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f"] Sep 10 17:48:35.249400 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.249378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.258971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.258193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.258971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.258244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjjh\" (UniqueName: \"kubernetes.io/projected/1a53fef9-0c66-46f1-bb26-e158346e2466-kube-api-access-npjjh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.258971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.258273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.258971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.258311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg46p\" (UniqueName: \"kubernetes.io/projected/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-kube-api-access-fg46p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.258971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.258368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.258971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.258467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.261026 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.260729 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f"] Sep 10 17:48:35.306665 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.306637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:35.360498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.359635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjjh\" (UniqueName: \"kubernetes.io/projected/1a53fef9-0c66-46f1-bb26-e158346e2466-kube-api-access-npjjh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.360498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.359682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.360498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.359723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg46p\" (UniqueName: \"kubernetes.io/projected/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-kube-api-access-fg46p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.360498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.359778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.360498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.359853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.360498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.359892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.360498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.360295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.360959 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.360509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.360959 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.360536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.360959 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.360615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.371967 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.371942 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg46p\" (UniqueName: \"kubernetes.io/projected/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-kube-api-access-fg46p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.372080 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.371976 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjjh\" (UniqueName: \"kubernetes.io/projected/1a53fef9-0c66-46f1-bb26-e158346e2466-kube-api-access-npjjh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.480895 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.480868 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh"] Sep 10 17:48:35.481841 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:48:35.481804 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd5cf76_a97e_44bc_a78a_55667c8a0ad3.slice/crio-fbdce3b231138aa12986e20ad32956cf883d2390f616550ef7e973e5b5015dbf WatchSource:0}: Error finding container fbdce3b231138aa12986e20ad32956cf883d2390f616550ef7e973e5b5015dbf: Status 404 returned error can't find the container with id fbdce3b231138aa12986e20ad32956cf883d2390f616550ef7e973e5b5015dbf Sep 10 17:48:35.487974 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.487947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:35.562108 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.562078 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:35.579712 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.579683 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp"] Sep 10 17:48:35.582829 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:48:35.582790 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbdc19d_1912_4913_b1db_9fc8e7a7566a.slice/crio-86af9b8c1e1ec7a7d00efd9a28e822f5e9ccd24289d1eb9a9c6b55b960b4e9ab WatchSource:0}: Error finding container 86af9b8c1e1ec7a7d00efd9a28e822f5e9ccd24289d1eb9a9c6b55b960b4e9ab: Status 404 returned error can't find the container with id 86af9b8c1e1ec7a7d00efd9a28e822f5e9ccd24289d1eb9a9c6b55b960b4e9ab Sep 10 17:48:35.764903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.764881 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c"] Sep 10 17:48:35.766149 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:48:35.766124 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a53fef9_0c66_46f1_bb26_e158346e2466.slice/crio-c8f933810e6add3064d3fe04caab8f4085f560be75312dda0db7ca5d1e815c99 WatchSource:0}: Error finding container c8f933810e6add3064d3fe04caab8f4085f560be75312dda0db7ca5d1e815c99: Status 404 returned error can't find the container with id c8f933810e6add3064d3fe04caab8f4085f560be75312dda0db7ca5d1e815c99 Sep 10 17:48:35.836926 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:35.836901 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f"] Sep 10 17:48:35.838383 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:48:35.838358 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320cb4ca_4b8d_4961_b473_ec3086a6ba0b.slice/crio-d80cf840b9c69de7dd6398f44f168a631a34f11812f7ee5308dff9cb5af951c0 WatchSource:0}: Error finding container d80cf840b9c69de7dd6398f44f168a631a34f11812f7ee5308dff9cb5af951c0: Status 404 returned error can't find the container with id d80cf840b9c69de7dd6398f44f168a631a34f11812f7ee5308dff9cb5af951c0 Sep 10 17:48:36.259132 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.259098 2580 generic.go:356] "Generic (PLEG): container finished" podID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerID="ee872bd242d50fc61ef4743f9a21c6424678f3acdbc7cb8be1fd15fc5071aa43" exitCode=0 Sep 10 17:48:36.259572 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.259189 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" event={"ID":"320cb4ca-4b8d-4961-b473-ec3086a6ba0b","Type":"ContainerDied","Data":"ee872bd242d50fc61ef4743f9a21c6424678f3acdbc7cb8be1fd15fc5071aa43"} Sep 10 17:48:36.259572 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.259246 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" event={"ID":"320cb4ca-4b8d-4961-b473-ec3086a6ba0b","Type":"ContainerStarted","Data":"d80cf840b9c69de7dd6398f44f168a631a34f11812f7ee5308dff9cb5af951c0"} Sep 10 17:48:36.260813 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.260796 2580 generic.go:356] "Generic (PLEG): container finished" podID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerID="fbb8dea9321857175bb766f1a80997b6dadbd872a6c2d3ad856644c11ff28bf1" exitCode=0 Sep 10 17:48:36.260913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.260868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" event={"ID":"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3","Type":"ContainerDied","Data":"fbb8dea9321857175bb766f1a80997b6dadbd872a6c2d3ad856644c11ff28bf1"} Sep 10 17:48:36.260913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.260906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" event={"ID":"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3","Type":"ContainerStarted","Data":"fbdce3b231138aa12986e20ad32956cf883d2390f616550ef7e973e5b5015dbf"} Sep 10 17:48:36.262521 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.262501 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerID="0b980fb82f51685ff249033a94d4948e94ae3f80baec1928d49c63cb918669e9" exitCode=0 Sep 10 17:48:36.262607 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.262527 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" event={"ID":"1a53fef9-0c66-46f1-bb26-e158346e2466","Type":"ContainerDied","Data":"0b980fb82f51685ff249033a94d4948e94ae3f80baec1928d49c63cb918669e9"} Sep 10 17:48:36.262607 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.262571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" event={"ID":"1a53fef9-0c66-46f1-bb26-e158346e2466","Type":"ContainerStarted","Data":"c8f933810e6add3064d3fe04caab8f4085f560be75312dda0db7ca5d1e815c99"} Sep 10 17:48:36.264254 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.264236 2580 generic.go:356] "Generic (PLEG): container finished" podID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerID="0154d2f41cdd51e856cab9757ae10302da75b44bbfb6d77cac9755e0b1c841aa" exitCode=0 Sep 10 17:48:36.264345 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.264284 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" event={"ID":"4dbdc19d-1912-4913-b1db-9fc8e7a7566a","Type":"ContainerDied","Data":"0154d2f41cdd51e856cab9757ae10302da75b44bbfb6d77cac9755e0b1c841aa"} Sep 10 17:48:36.264345 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:36.264306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" event={"ID":"4dbdc19d-1912-4913-b1db-9fc8e7a7566a","Type":"ContainerStarted","Data":"86af9b8c1e1ec7a7d00efd9a28e822f5e9ccd24289d1eb9a9c6b55b960b4e9ab"} Sep 10 17:48:37.271005 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.270972 2580 generic.go:356] "Generic (PLEG): container finished" podID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerID="f03eb9bf8e3fbf48cc72e6547110e7e8b833b61636cb605cdbdcb495e0384ecd" exitCode=0 Sep 10 17:48:37.271318 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.271017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" event={"ID":"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3","Type":"ContainerDied","Data":"f03eb9bf8e3fbf48cc72e6547110e7e8b833b61636cb605cdbdcb495e0384ecd"} Sep 10 17:48:37.273242 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.273220 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerID="ccee9df9cee6fb0d62daac85633967f5cb1593472eeebc96c1348bc05b5c04c9" exitCode=0 Sep 10 17:48:37.273343 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.273287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" event={"ID":"1a53fef9-0c66-46f1-bb26-e158346e2466","Type":"ContainerDied","Data":"ccee9df9cee6fb0d62daac85633967f5cb1593472eeebc96c1348bc05b5c04c9"} Sep 10 17:48:37.275238 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.275217 2580 generic.go:356] "Generic (PLEG): container finished" podID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerID="3e7d24290abe59c80b71fa8040ab56724ce2fae6ddd22e77274d322fd08b389e" exitCode=0 Sep 10 17:48:37.275313 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.275289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" event={"ID":"4dbdc19d-1912-4913-b1db-9fc8e7a7566a","Type":"ContainerDied","Data":"3e7d24290abe59c80b71fa8040ab56724ce2fae6ddd22e77274d322fd08b389e"} Sep 10 17:48:37.277250 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.277231 2580 generic.go:356] "Generic (PLEG): container finished" podID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerID="a00ab8d5ded81db80294b4962d9a58d6368301ec2e4c9a3879fca40d510c3609" exitCode=0 Sep 10 17:48:37.277356 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:37.277262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" event={"ID":"320cb4ca-4b8d-4961-b473-ec3086a6ba0b","Type":"ContainerDied","Data":"a00ab8d5ded81db80294b4962d9a58d6368301ec2e4c9a3879fca40d510c3609"} Sep 10 17:48:38.284456 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.284425 2580 generic.go:356] "Generic (PLEG): container finished" podID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerID="0f05da2d9810c8a4db745b10b8b3d55194501e7aa4788cb60b8805e979e71fc4" exitCode=0 Sep 10 17:48:38.284918 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.284514 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" event={"ID":"320cb4ca-4b8d-4961-b473-ec3086a6ba0b","Type":"ContainerDied","Data":"0f05da2d9810c8a4db745b10b8b3d55194501e7aa4788cb60b8805e979e71fc4"} Sep 10 17:48:38.286397 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.286377 2580 generic.go:356] "Generic (PLEG): container finished" podID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerID="bd1e252637769f942495801545876def247539ac0187fcd20e36d066646aabb9" exitCode=0 Sep 10 17:48:38.286502 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.286406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" event={"ID":"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3","Type":"ContainerDied","Data":"bd1e252637769f942495801545876def247539ac0187fcd20e36d066646aabb9"} Sep 10 17:48:38.288378 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.288359 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerID="85f1f46e37dae5e57dfeca71142ff35c392440e673b400cd083d08c9371d92f1" exitCode=0 Sep 10 17:48:38.288482 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.288422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" event={"ID":"1a53fef9-0c66-46f1-bb26-e158346e2466","Type":"ContainerDied","Data":"85f1f46e37dae5e57dfeca71142ff35c392440e673b400cd083d08c9371d92f1"} Sep 10 17:48:38.290228 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.290210 2580 generic.go:356] "Generic (PLEG): container finished" podID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerID="8cfc12980556555ea18de3bc4aab8d2209319078abfc6f5517edd551eefb8bf5" exitCode=0 Sep 10 17:48:38.290336 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:38.290275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" event={"ID":"4dbdc19d-1912-4913-b1db-9fc8e7a7566a","Type":"ContainerDied","Data":"8cfc12980556555ea18de3bc4aab8d2209319078abfc6f5517edd551eefb8bf5"} Sep 10 17:48:39.428173 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.428150 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:39.466708 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.466681 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:39.489052 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.489031 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7hwg\" (UniqueName: \"kubernetes.io/projected/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-kube-api-access-d7hwg\") pod \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " Sep 10 17:48:39.489163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.489098 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-util\") pod \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " Sep 10 17:48:39.489163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.489124 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-util\") pod \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " Sep 10 17:48:39.489264 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.489170 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dqld\" (UniqueName: \"kubernetes.io/projected/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-kube-api-access-6dqld\") pod \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " Sep 10 17:48:39.489264 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.489208 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-bundle\") pod \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\" (UID: \"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3\") " Sep 10 17:48:39.489413 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.489289 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-bundle\") pod \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\" (UID: \"4dbdc19d-1912-4913-b1db-9fc8e7a7566a\") " Sep 10 17:48:39.489979 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.489952 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-bundle" (OuterVolumeSpecName: "bundle") pod "4dbdc19d-1912-4913-b1db-9fc8e7a7566a" (UID: "4dbdc19d-1912-4913-b1db-9fc8e7a7566a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.490152 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.490112 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-bundle" (OuterVolumeSpecName: "bundle") pod "4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" (UID: "4cd5cf76-a97e-44bc-a78a-55667c8a0ad3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.492122 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.492096 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-kube-api-access-6dqld" (OuterVolumeSpecName: "kube-api-access-6dqld") pod "4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" (UID: "4cd5cf76-a97e-44bc-a78a-55667c8a0ad3"). InnerVolumeSpecName "kube-api-access-6dqld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:39.492943 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.492897 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-kube-api-access-d7hwg" (OuterVolumeSpecName: "kube-api-access-d7hwg") pod "4dbdc19d-1912-4913-b1db-9fc8e7a7566a" (UID: "4dbdc19d-1912-4913-b1db-9fc8e7a7566a"). InnerVolumeSpecName "kube-api-access-d7hwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:39.496170 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.496149 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-util" (OuterVolumeSpecName: "util") pod "4dbdc19d-1912-4913-b1db-9fc8e7a7566a" (UID: "4dbdc19d-1912-4913-b1db-9fc8e7a7566a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.497072 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.497051 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-util" (OuterVolumeSpecName: "util") pod "4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" (UID: "4cd5cf76-a97e-44bc-a78a-55667c8a0ad3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.501482 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.501465 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:39.503447 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.503431 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:39.589745 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.589680 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-bundle\") pod \"1a53fef9-0c66-46f1-bb26-e158346e2466\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " Sep 10 17:48:39.589745 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.589736 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-bundle\") pod \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " Sep 10 17:48:39.589968 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.589758 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-util\") pod \"1a53fef9-0c66-46f1-bb26-e158346e2466\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " Sep 10 17:48:39.589968 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.589777 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-util\") pod \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " Sep 10 17:48:39.589968 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.589837 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npjjh\" (UniqueName: \"kubernetes.io/projected/1a53fef9-0c66-46f1-bb26-e158346e2466-kube-api-access-npjjh\") pod \"1a53fef9-0c66-46f1-bb26-e158346e2466\" (UID: \"1a53fef9-0c66-46f1-bb26-e158346e2466\") " Sep 10 17:48:39.589968 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.589858 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg46p\" (UniqueName: \"kubernetes.io/projected/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-kube-api-access-fg46p\") pod \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\" (UID: \"320cb4ca-4b8d-4961-b473-ec3086a6ba0b\") " Sep 10 17:48:39.590167 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590025 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.590167 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590040 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.590167 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590052 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dqld\" (UniqueName: \"kubernetes.io/projected/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-kube-api-access-6dqld\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.590167 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590066 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd5cf76-a97e-44bc-a78a-55667c8a0ad3-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.590167 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590078 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.590167 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590092 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7hwg\" (UniqueName: \"kubernetes.io/projected/4dbdc19d-1912-4913-b1db-9fc8e7a7566a-kube-api-access-d7hwg\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.590445 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590344 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-bundle" (OuterVolumeSpecName: "bundle") pod "1a53fef9-0c66-46f1-bb26-e158346e2466" (UID: "1a53fef9-0c66-46f1-bb26-e158346e2466"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.590625 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.590603 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-bundle" (OuterVolumeSpecName: "bundle") pod "320cb4ca-4b8d-4961-b473-ec3086a6ba0b" (UID: "320cb4ca-4b8d-4961-b473-ec3086a6ba0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.592345 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.592326 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-kube-api-access-fg46p" (OuterVolumeSpecName: "kube-api-access-fg46p") pod "320cb4ca-4b8d-4961-b473-ec3086a6ba0b" (UID: "320cb4ca-4b8d-4961-b473-ec3086a6ba0b"). InnerVolumeSpecName "kube-api-access-fg46p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:39.592413 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.592340 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a53fef9-0c66-46f1-bb26-e158346e2466-kube-api-access-npjjh" (OuterVolumeSpecName: "kube-api-access-npjjh") pod "1a53fef9-0c66-46f1-bb26-e158346e2466" (UID: "1a53fef9-0c66-46f1-bb26-e158346e2466"). InnerVolumeSpecName "kube-api-access-npjjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:39.595408 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.595387 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-util" (OuterVolumeSpecName: "util") pod "320cb4ca-4b8d-4961-b473-ec3086a6ba0b" (UID: "320cb4ca-4b8d-4961-b473-ec3086a6ba0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.595544 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.595528 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-util" (OuterVolumeSpecName: "util") pod "1a53fef9-0c66-46f1-bb26-e158346e2466" (UID: "1a53fef9-0c66-46f1-bb26-e158346e2466"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:39.691400 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.691376 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.691400 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.691397 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-util\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.691518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.691407 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npjjh\" (UniqueName: \"kubernetes.io/projected/1a53fef9-0c66-46f1-bb26-e158346e2466-kube-api-access-npjjh\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.691518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.691417 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg46p\" (UniqueName: \"kubernetes.io/projected/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-kube-api-access-fg46p\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.691518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.691426 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a53fef9-0c66-46f1-bb26-e158346e2466-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.691518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:39.691434 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320cb4ca-4b8d-4961-b473-ec3086a6ba0b-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:48:40.302513 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.302488 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" Sep 10 17:48:40.302513 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.302491 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alvn6f" event={"ID":"320cb4ca-4b8d-4961-b473-ec3086a6ba0b","Type":"ContainerDied","Data":"d80cf840b9c69de7dd6398f44f168a631a34f11812f7ee5308dff9cb5af951c0"} Sep 10 17:48:40.302742 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.302538 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d80cf840b9c69de7dd6398f44f168a631a34f11812f7ee5308dff9cb5af951c0" Sep 10 17:48:40.304283 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.304258 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" Sep 10 17:48:40.304283 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.304275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhpkh" event={"ID":"4cd5cf76-a97e-44bc-a78a-55667c8a0ad3","Type":"ContainerDied","Data":"fbdce3b231138aa12986e20ad32956cf883d2390f616550ef7e973e5b5015dbf"} Sep 10 17:48:40.304463 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.304307 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbdce3b231138aa12986e20ad32956cf883d2390f616550ef7e973e5b5015dbf" Sep 10 17:48:40.306331 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.306303 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" event={"ID":"1a53fef9-0c66-46f1-bb26-e158346e2466","Type":"ContainerDied","Data":"c8f933810e6add3064d3fe04caab8f4085f560be75312dda0db7ca5d1e815c99"} Sep 10 17:48:40.306331 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.306322 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clmv4c" Sep 10 17:48:40.306483 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.306348 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8f933810e6add3064d3fe04caab8f4085f560be75312dda0db7ca5d1e815c99" Sep 10 17:48:40.308495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.308472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" event={"ID":"4dbdc19d-1912-4913-b1db-9fc8e7a7566a","Type":"ContainerDied","Data":"86af9b8c1e1ec7a7d00efd9a28e822f5e9ccd24289d1eb9a9c6b55b960b4e9ab"} Sep 10 17:48:40.308495 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.308481 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t86gp" Sep 10 17:48:40.308642 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:48:40.308499 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86af9b8c1e1ec7a7d00efd9a28e822f5e9ccd24289d1eb9a9c6b55b960b4e9ab" Sep 10 17:49:36.941779 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:36.941750 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:49:36.946608 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:36.946589 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:49:41.423742 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.423710 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz"] Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424005 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424017 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424030 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424036 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424043 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424048 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424052 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424057 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424065 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424074 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424083 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424088 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerName="util" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424093 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424098 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424104 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424108 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerName="pull" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424114 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerName="extract" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424118 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerName="extract" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424123 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerName="extract" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424128 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerName="extract" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424134 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerName="extract" Sep 10 17:49:41.424137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424140 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerName="extract" Sep 10 17:49:41.424829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424150 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerName="extract" Sep 10 17:49:41.424829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424155 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerName="extract" Sep 10 17:49:41.424829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424201 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a53fef9-0c66-46f1-bb26-e158346e2466" containerName="extract" Sep 10 17:49:41.424829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424209 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="320cb4ca-4b8d-4961-b473-ec3086a6ba0b" containerName="extract" Sep 10 17:49:41.424829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424215 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dbdc19d-1912-4913-b1db-9fc8e7a7566a" containerName="extract" Sep 10 17:49:41.424829 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.424223 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cd5cf76-a97e-44bc-a78a-55667c8a0ad3" containerName="extract" Sep 10 17:49:41.426727 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.426708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.429541 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.429522 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5z4d\"" Sep 10 17:49:41.439468 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.439445 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz"] Sep 10 17:49:41.560508 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560478 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xswqc\" (UniqueName: \"kubernetes.io/projected/fdbe1b87-6d50-46b8-b721-693b516f6e97-kube-api-access-xswqc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560914 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.560914 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.560675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbe1b87-6d50-46b8-b721-693b516f6e97-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661027 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.660998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xswqc\" (UniqueName: \"kubernetes.io/projected/fdbe1b87-6d50-46b8-b721-693b516f6e97-kube-api-access-xswqc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661163 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661372 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661372 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661372 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661372 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbe1b87-6d50-46b8-b721-693b516f6e97-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661575 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661628 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661579 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661664 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661617 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661758 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.661964 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.661945 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbe1b87-6d50-46b8-b721-693b516f6e97-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.663459 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.663440 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.663535 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.663445 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.668779 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.668754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbe1b87-6d50-46b8-b721-693b516f6e97-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.668884 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.668813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xswqc\" (UniqueName: \"kubernetes.io/projected/fdbe1b87-6d50-46b8-b721-693b516f6e97-kube-api-access-xswqc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hzsxz\" (UID: \"fdbe1b87-6d50-46b8-b721-693b516f6e97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:41.736009 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:41.735959 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:42.007732 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.007708 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz"] Sep 10 17:49:42.009563 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:49:42.009538 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbe1b87_6d50_46b8_b721_693b516f6e97.slice/crio-8d26318972cbe6e781aa5eaeac6a7b31a89e03bc0e0c7db2136b60daf9b85724 WatchSource:0}: Error finding container 8d26318972cbe6e781aa5eaeac6a7b31a89e03bc0e0c7db2136b60daf9b85724: Status 404 returned error can't find the container with id 8d26318972cbe6e781aa5eaeac6a7b31a89e03bc0e0c7db2136b60daf9b85724 Sep 10 17:49:42.011856 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.011799 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:49:42.011943 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.011881 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:49:42.011943 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.011934 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:49:42.604349 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.604314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" event={"ID":"fdbe1b87-6d50-46b8-b721-693b516f6e97","Type":"ContainerStarted","Data":"595d9c33138ffa6dcebc1d9c0d6196cc56f28b9ce23555f6df464bc96cde9ec0"} Sep 10 17:49:42.604743 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.604365 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" event={"ID":"fdbe1b87-6d50-46b8-b721-693b516f6e97","Type":"ContainerStarted","Data":"8d26318972cbe6e781aa5eaeac6a7b31a89e03bc0e0c7db2136b60daf9b85724"} Sep 10 17:49:42.627273 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.627229 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" podStartSLOduration=1.6272110579999999 podStartE2EDuration="1.627211058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:42.625480469 +0000 UTC m=+606.080066803" watchObservedRunningTime="2026-09-10 17:49:42.627211058 +0000 UTC m=+606.081797391" Sep 10 17:49:42.736738 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:42.736710 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:43.741459 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:43.741425 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:44.613874 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:44.613842 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:44.614792 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:44.614768 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:49:58.585705 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.585670 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2mdlw"] Sep 10 17:49:58.588872 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.588852 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" Sep 10 17:49:58.591220 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.591201 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 17:49:58.591328 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.591238 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2qf9f\"" Sep 10 17:49:58.591612 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.591595 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 17:49:58.594218 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.594196 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2mdlw"] Sep 10 17:49:58.710386 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.710356 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-clh7j"] Sep 10 17:49:58.713324 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.713310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-clh7j" Sep 10 17:49:58.719833 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.719761 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-clh7j"] Sep 10 17:49:58.786438 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.786407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shjff\" (UniqueName: \"kubernetes.io/projected/a5a3b35c-9ff6-4425-bf71-753d494b1ed5-kube-api-access-shjff\") pod \"authorino-7bcfd8f9cd-2mdlw\" (UID: \"a5a3b35c-9ff6-4425-bf71-753d494b1ed5\") " pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" Sep 10 17:49:58.887208 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.887186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shjff\" (UniqueName: \"kubernetes.io/projected/a5a3b35c-9ff6-4425-bf71-753d494b1ed5-kube-api-access-shjff\") pod \"authorino-7bcfd8f9cd-2mdlw\" (UID: \"a5a3b35c-9ff6-4425-bf71-753d494b1ed5\") " pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" Sep 10 17:49:58.887330 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.887241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmqx\" (UniqueName: \"kubernetes.io/projected/f7e228e8-aec9-4570-bbf5-a77a89fc6144-kube-api-access-knmqx\") pod \"authorino-59c974bd48-clh7j\" (UID: \"f7e228e8-aec9-4570-bbf5-a77a89fc6144\") " pod="kuadrant-system/authorino-59c974bd48-clh7j" Sep 10 17:49:58.895779 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.895751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shjff\" (UniqueName: \"kubernetes.io/projected/a5a3b35c-9ff6-4425-bf71-753d494b1ed5-kube-api-access-shjff\") pod \"authorino-7bcfd8f9cd-2mdlw\" (UID: \"a5a3b35c-9ff6-4425-bf71-753d494b1ed5\") " pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" Sep 10 17:49:58.898513 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.898497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" Sep 10 17:49:58.988024 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.987995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knmqx\" (UniqueName: \"kubernetes.io/projected/f7e228e8-aec9-4570-bbf5-a77a89fc6144-kube-api-access-knmqx\") pod \"authorino-59c974bd48-clh7j\" (UID: \"f7e228e8-aec9-4570-bbf5-a77a89fc6144\") " pod="kuadrant-system/authorino-59c974bd48-clh7j" Sep 10 17:49:58.996086 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:58.996061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmqx\" (UniqueName: \"kubernetes.io/projected/f7e228e8-aec9-4570-bbf5-a77a89fc6144-kube-api-access-knmqx\") pod \"authorino-59c974bd48-clh7j\" (UID: \"f7e228e8-aec9-4570-bbf5-a77a89fc6144\") " pod="kuadrant-system/authorino-59c974bd48-clh7j" Sep 10 17:49:59.022870 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:59.022847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-clh7j" Sep 10 17:49:59.166893 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:59.166869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2mdlw"] Sep 10 17:49:59.168488 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:49:59.168465 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5a3b35c_9ff6_4425_bf71_753d494b1ed5.slice/crio-63eded80b3ded07009077af974d64d8948164618d99200fe877d9f727f91292a WatchSource:0}: Error finding container 63eded80b3ded07009077af974d64d8948164618d99200fe877d9f727f91292a: Status 404 returned error can't find the container with id 63eded80b3ded07009077af974d64d8948164618d99200fe877d9f727f91292a Sep 10 17:49:59.290021 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:59.289994 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-clh7j"] Sep 10 17:49:59.291719 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:49:59.291690 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7e228e8_aec9_4570_bbf5_a77a89fc6144.slice/crio-b2edc877e1e2adc8bc48abf922df12bb7372b0304ec6e99f3e780a41651dfacf WatchSource:0}: Error finding container b2edc877e1e2adc8bc48abf922df12bb7372b0304ec6e99f3e780a41651dfacf: Status 404 returned error can't find the container with id b2edc877e1e2adc8bc48abf922df12bb7372b0304ec6e99f3e780a41651dfacf Sep 10 17:49:59.688522 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:59.688483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-clh7j" event={"ID":"f7e228e8-aec9-4570-bbf5-a77a89fc6144","Type":"ContainerStarted","Data":"b2edc877e1e2adc8bc48abf922df12bb7372b0304ec6e99f3e780a41651dfacf"} Sep 10 17:49:59.690153 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:49:59.690115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" event={"ID":"a5a3b35c-9ff6-4425-bf71-753d494b1ed5","Type":"ContainerStarted","Data":"63eded80b3ded07009077af974d64d8948164618d99200fe877d9f727f91292a"} Sep 10 17:50:01.704118 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:01.704085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-clh7j" event={"ID":"f7e228e8-aec9-4570-bbf5-a77a89fc6144","Type":"ContainerStarted","Data":"c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77"} Sep 10 17:50:01.706397 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:01.706366 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" event={"ID":"a5a3b35c-9ff6-4425-bf71-753d494b1ed5","Type":"ContainerStarted","Data":"e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc"} Sep 10 17:50:01.717653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:01.717612 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-clh7j" podStartSLOduration=1.389770667 podStartE2EDuration="3.717597269s" totalImagesPullingTime="2.327826602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:01.715758673 +0000 UTC m=+625.170345007" watchObservedRunningTime="2026-09-10 17:50:01.717597269 +0000 UTC m=+625.172183603" Sep 10 17:50:01.730243 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:01.730195 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" podStartSLOduration=1.268839016 podStartE2EDuration="3.730179582s" totalImagesPullingTime="2.461340566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:01.727577843 +0000 UTC m=+625.182164167" watchObservedRunningTime="2026-09-10 17:50:01.730179582 +0000 UTC m=+625.184765915" Sep 10 17:50:01.752562 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:01.752536 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2mdlw"] Sep 10 17:50:03.722190 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:03.722153 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" podUID="a5a3b35c-9ff6-4425-bf71-753d494b1ed5" containerName="authorino" containerID="cri-o://e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc" gracePeriod=30 Sep 10 17:50:03.956772 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:03.956746 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" Sep 10 17:50:04.026190 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.026120 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shjff\" (UniqueName: \"kubernetes.io/projected/a5a3b35c-9ff6-4425-bf71-753d494b1ed5-kube-api-access-shjff\") pod \"a5a3b35c-9ff6-4425-bf71-753d494b1ed5\" (UID: \"a5a3b35c-9ff6-4425-bf71-753d494b1ed5\") " Sep 10 17:50:04.028160 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.028134 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a3b35c-9ff6-4425-bf71-753d494b1ed5-kube-api-access-shjff" (OuterVolumeSpecName: "kube-api-access-shjff") pod "a5a3b35c-9ff6-4425-bf71-753d494b1ed5" (UID: "a5a3b35c-9ff6-4425-bf71-753d494b1ed5"). InnerVolumeSpecName "kube-api-access-shjff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:50:04.127674 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.127645 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shjff\" (UniqueName: \"kubernetes.io/projected/a5a3b35c-9ff6-4425-bf71-753d494b1ed5-kube-api-access-shjff\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:50:04.728786 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.728749 2580 generic.go:356] "Generic (PLEG): container finished" podID="a5a3b35c-9ff6-4425-bf71-753d494b1ed5" containerID="e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc" exitCode=0 Sep 10 17:50:04.728786 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.728786 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" Sep 10 17:50:04.729225 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.728796 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" event={"ID":"a5a3b35c-9ff6-4425-bf71-753d494b1ed5","Type":"ContainerDied","Data":"e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc"} Sep 10 17:50:04.729225 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.728855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2mdlw" event={"ID":"a5a3b35c-9ff6-4425-bf71-753d494b1ed5","Type":"ContainerDied","Data":"63eded80b3ded07009077af974d64d8948164618d99200fe877d9f727f91292a"} Sep 10 17:50:04.729225 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.728875 2580 scope.go:117] "RemoveContainer" containerID="e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc" Sep 10 17:50:04.738753 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.738737 2580 scope.go:117] "RemoveContainer" containerID="e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc" Sep 10 17:50:04.739043 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:50:04.739026 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc\": container with ID starting with e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc not found: ID does not exist" containerID="e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc" Sep 10 17:50:04.739094 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.739050 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc"} err="failed to get container status \"e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc\": rpc error: code = NotFound desc = could not find container \"e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc\": container with ID starting with e7648ce74d330bc203418527fcbc6bc7062143c2c64011aaea823a34b35aeccc not found: ID does not exist" Sep 10 17:50:04.754116 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.754092 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2mdlw"] Sep 10 17:50:04.759232 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.759213 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2mdlw"] Sep 10 17:50:04.993989 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:04.993914 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5a3b35c-9ff6-4425-bf71-753d494b1ed5" path="/var/lib/kubelet/pods/a5a3b35c-9ff6-4425-bf71-753d494b1ed5/volumes" Sep 10 17:50:25.836317 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.836285 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-rth9w"] Sep 10 17:50:25.836913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.836726 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5a3b35c-9ff6-4425-bf71-753d494b1ed5" containerName="authorino" Sep 10 17:50:25.836913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.836744 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5a3b35c-9ff6-4425-bf71-753d494b1ed5" containerName="authorino" Sep 10 17:50:25.836913 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.836860 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5a3b35c-9ff6-4425-bf71-753d494b1ed5" containerName="authorino" Sep 10 17:50:25.840995 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.840974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rth9w" Sep 10 17:50:25.848678 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.848656 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-rth9w"] Sep 10 17:50:25.893280 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.893250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2zsf\" (UniqueName: \"kubernetes.io/projected/be7b1f33-f79e-4124-9b94-f7358fbdb880-kube-api-access-w2zsf\") pod \"authorino-557f876f69-rth9w\" (UID: \"be7b1f33-f79e-4124-9b94-f7358fbdb880\") " pod="kuadrant-system/authorino-557f876f69-rth9w" Sep 10 17:50:25.938141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.938114 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rth9w"] Sep 10 17:50:25.938313 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:50:25.938295 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-w2zsf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-rth9w" podUID="be7b1f33-f79e-4124-9b94-f7358fbdb880" Sep 10 17:50:25.968341 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.968318 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mkl87"] Sep 10 17:50:25.971397 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.971380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:25.973668 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.973652 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 17:50:25.978879 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.978859 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mkl87"] Sep 10 17:50:25.993600 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:25.993578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2zsf\" (UniqueName: \"kubernetes.io/projected/be7b1f33-f79e-4124-9b94-f7358fbdb880-kube-api-access-w2zsf\") pod \"authorino-557f876f69-rth9w\" (UID: \"be7b1f33-f79e-4124-9b94-f7358fbdb880\") " pod="kuadrant-system/authorino-557f876f69-rth9w" Sep 10 17:50:26.000266 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.000246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2zsf\" (UniqueName: \"kubernetes.io/projected/be7b1f33-f79e-4124-9b94-f7358fbdb880-kube-api-access-w2zsf\") pod \"authorino-557f876f69-rth9w\" (UID: \"be7b1f33-f79e-4124-9b94-f7358fbdb880\") " pod="kuadrant-system/authorino-557f876f69-rth9w" Sep 10 17:50:26.089933 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.089870 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mkl87"] Sep 10 17:50:26.090102 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:50:26.090080 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hq7lr tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-mkl87" podUID="57904191-8d77-480c-9365-928825ba7e40" Sep 10 17:50:26.094293 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.094274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57904191-8d77-480c-9365-928825ba7e40-tls-cert\") pod \"authorino-6d4dfc649f-mkl87\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.094351 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.094312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7lr\" (UniqueName: \"kubernetes.io/projected/57904191-8d77-480c-9365-928825ba7e40-kube-api-access-hq7lr\") pod \"authorino-6d4dfc649f-mkl87\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.119765 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.119738 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-674554c755-r2m54"] Sep 10 17:50:26.123195 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.123177 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.130277 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.130258 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674554c755-r2m54"] Sep 10 17:50:26.194920 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.194898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfrg8\" (UniqueName: \"kubernetes.io/projected/d77dd4a1-9ffa-44cf-850c-d8898175e265-kube-api-access-jfrg8\") pod \"authorino-674554c755-r2m54\" (UID: \"d77dd4a1-9ffa-44cf-850c-d8898175e265\") " pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.195014 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.194928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57904191-8d77-480c-9365-928825ba7e40-tls-cert\") pod \"authorino-6d4dfc649f-mkl87\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.195014 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.194964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7lr\" (UniqueName: \"kubernetes.io/projected/57904191-8d77-480c-9365-928825ba7e40-kube-api-access-hq7lr\") pod \"authorino-6d4dfc649f-mkl87\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.195087 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.195031 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d77dd4a1-9ffa-44cf-850c-d8898175e265-tls-cert\") pod \"authorino-674554c755-r2m54\" (UID: \"d77dd4a1-9ffa-44cf-850c-d8898175e265\") " pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.197177 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.197152 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57904191-8d77-480c-9365-928825ba7e40-tls-cert\") pod \"authorino-6d4dfc649f-mkl87\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.205395 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.205375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7lr\" (UniqueName: \"kubernetes.io/projected/57904191-8d77-480c-9365-928825ba7e40-kube-api-access-hq7lr\") pod \"authorino-6d4dfc649f-mkl87\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.295557 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.295534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d77dd4a1-9ffa-44cf-850c-d8898175e265-tls-cert\") pod \"authorino-674554c755-r2m54\" (UID: \"d77dd4a1-9ffa-44cf-850c-d8898175e265\") " pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.295642 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.295587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfrg8\" (UniqueName: \"kubernetes.io/projected/d77dd4a1-9ffa-44cf-850c-d8898175e265-kube-api-access-jfrg8\") pod \"authorino-674554c755-r2m54\" (UID: \"d77dd4a1-9ffa-44cf-850c-d8898175e265\") " pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.297553 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.297530 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d77dd4a1-9ffa-44cf-850c-d8898175e265-tls-cert\") pod \"authorino-674554c755-r2m54\" (UID: \"d77dd4a1-9ffa-44cf-850c-d8898175e265\") " pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.302790 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.302773 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfrg8\" (UniqueName: \"kubernetes.io/projected/d77dd4a1-9ffa-44cf-850c-d8898175e265-kube-api-access-jfrg8\") pod \"authorino-674554c755-r2m54\" (UID: \"d77dd4a1-9ffa-44cf-850c-d8898175e265\") " pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.432226 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.432204 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674554c755-r2m54" Sep 10 17:50:26.700531 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.700507 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674554c755-r2m54"] Sep 10 17:50:26.702509 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:50:26.702481 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd77dd4a1_9ffa_44cf_850c_d8898175e265.slice/crio-a8a17f1544263c10e0d4fe3fe54a9ee4f30fa855b7098ba8aa300b49e1f40402 WatchSource:0}: Error finding container a8a17f1544263c10e0d4fe3fe54a9ee4f30fa855b7098ba8aa300b49e1f40402: Status 404 returned error can't find the container with id a8a17f1544263c10e0d4fe3fe54a9ee4f30fa855b7098ba8aa300b49e1f40402 Sep 10 17:50:26.837171 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.837144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674554c755-r2m54" event={"ID":"d77dd4a1-9ffa-44cf-850c-d8898175e265","Type":"ContainerStarted","Data":"a8a17f1544263c10e0d4fe3fe54a9ee4f30fa855b7098ba8aa300b49e1f40402"} Sep 10 17:50:26.837522 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.837176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.837522 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.837177 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rth9w" Sep 10 17:50:26.845217 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.845200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:26.847157 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.847141 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rth9w" Sep 10 17:50:26.900657 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.900639 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57904191-8d77-480c-9365-928825ba7e40-tls-cert\") pod \"57904191-8d77-480c-9365-928825ba7e40\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " Sep 10 17:50:26.900750 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.900666 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2zsf\" (UniqueName: \"kubernetes.io/projected/be7b1f33-f79e-4124-9b94-f7358fbdb880-kube-api-access-w2zsf\") pod \"be7b1f33-f79e-4124-9b94-f7358fbdb880\" (UID: \"be7b1f33-f79e-4124-9b94-f7358fbdb880\") " Sep 10 17:50:26.900750 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.900691 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq7lr\" (UniqueName: \"kubernetes.io/projected/57904191-8d77-480c-9365-928825ba7e40-kube-api-access-hq7lr\") pod \"57904191-8d77-480c-9365-928825ba7e40\" (UID: \"57904191-8d77-480c-9365-928825ba7e40\") " Sep 10 17:50:26.902752 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.902725 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57904191-8d77-480c-9365-928825ba7e40-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "57904191-8d77-480c-9365-928825ba7e40" (UID: "57904191-8d77-480c-9365-928825ba7e40"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:50:26.902861 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.902761 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57904191-8d77-480c-9365-928825ba7e40-kube-api-access-hq7lr" (OuterVolumeSpecName: "kube-api-access-hq7lr") pod "57904191-8d77-480c-9365-928825ba7e40" (UID: "57904191-8d77-480c-9365-928825ba7e40"). InnerVolumeSpecName "kube-api-access-hq7lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:50:26.902861 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:26.902768 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7b1f33-f79e-4124-9b94-f7358fbdb880-kube-api-access-w2zsf" (OuterVolumeSpecName: "kube-api-access-w2zsf") pod "be7b1f33-f79e-4124-9b94-f7358fbdb880" (UID: "be7b1f33-f79e-4124-9b94-f7358fbdb880"). InnerVolumeSpecName "kube-api-access-w2zsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:50:27.001352 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.001331 2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57904191-8d77-480c-9365-928825ba7e40-tls-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:50:27.001431 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.001353 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2zsf\" (UniqueName: \"kubernetes.io/projected/be7b1f33-f79e-4124-9b94-f7358fbdb880-kube-api-access-w2zsf\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:50:27.001431 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.001363 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq7lr\" (UniqueName: \"kubernetes.io/projected/57904191-8d77-480c-9365-928825ba7e40-kube-api-access-hq7lr\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:50:27.843291 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.843252 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674554c755-r2m54" event={"ID":"d77dd4a1-9ffa-44cf-850c-d8898175e265","Type":"ContainerStarted","Data":"cc566416ca55b6a4165b048728aad29f1e9c951aaaadaf1051d21860b86f17de"} Sep 10 17:50:27.843670 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.843395 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mkl87" Sep 10 17:50:27.843670 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.843507 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rth9w" Sep 10 17:50:27.859079 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.859030 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-674554c755-r2m54" podStartSLOduration=1.409475836 podStartE2EDuration="1.859014412s" totalImagesPullingTime="449.538576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:27.856962742 +0000 UTC m=+651.311549076" watchObservedRunningTime="2026-09-10 17:50:27.859014412 +0000 UTC m=+651.313600784" Sep 10 17:50:27.879478 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.879449 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mkl87"] Sep 10 17:50:27.885308 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.885279 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mkl87"] Sep 10 17:50:27.887695 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.887667 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-clh7j"] Sep 10 17:50:27.887846 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.887809 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-clh7j" podUID="f7e228e8-aec9-4570-bbf5-a77a89fc6144" containerName="authorino" containerID="cri-o://c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77" gracePeriod=30 Sep 10 17:50:27.908741 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.908718 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rth9w"] Sep 10 17:50:27.910500 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:27.910479 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-rth9w"] Sep 10 17:50:28.129043 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.129021 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-clh7j" Sep 10 17:50:28.208761 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.208736 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knmqx\" (UniqueName: \"kubernetes.io/projected/f7e228e8-aec9-4570-bbf5-a77a89fc6144-kube-api-access-knmqx\") pod \"f7e228e8-aec9-4570-bbf5-a77a89fc6144\" (UID: \"f7e228e8-aec9-4570-bbf5-a77a89fc6144\") " Sep 10 17:50:28.210641 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.210616 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e228e8-aec9-4570-bbf5-a77a89fc6144-kube-api-access-knmqx" (OuterVolumeSpecName: "kube-api-access-knmqx") pod "f7e228e8-aec9-4570-bbf5-a77a89fc6144" (UID: "f7e228e8-aec9-4570-bbf5-a77a89fc6144"). InnerVolumeSpecName "kube-api-access-knmqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:50:28.309634 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.309607 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knmqx\" (UniqueName: \"kubernetes.io/projected/f7e228e8-aec9-4570-bbf5-a77a89fc6144-kube-api-access-knmqx\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Sep 10 17:50:28.849712 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.849679 2580 generic.go:356] "Generic (PLEG): container finished" podID="f7e228e8-aec9-4570-bbf5-a77a89fc6144" containerID="c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77" exitCode=0 Sep 10 17:50:28.850118 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.849722 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-clh7j" Sep 10 17:50:28.850118 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.849766 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-clh7j" event={"ID":"f7e228e8-aec9-4570-bbf5-a77a89fc6144","Type":"ContainerDied","Data":"c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77"} Sep 10 17:50:28.850118 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.849806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-clh7j" event={"ID":"f7e228e8-aec9-4570-bbf5-a77a89fc6144","Type":"ContainerDied","Data":"b2edc877e1e2adc8bc48abf922df12bb7372b0304ec6e99f3e780a41651dfacf"} Sep 10 17:50:28.850118 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.849841 2580 scope.go:117] "RemoveContainer" containerID="c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77" Sep 10 17:50:28.858334 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.858317 2580 scope.go:117] "RemoveContainer" containerID="c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77" Sep 10 17:50:28.858632 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:50:28.858612 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77\": container with ID starting with c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77 not found: ID does not exist" containerID="c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77" Sep 10 17:50:28.858676 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.858640 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77"} err="failed to get container status \"c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77\": rpc error: code = NotFound desc = could not find container \"c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77\": container with ID starting with c43c8de0f8c878f9c76b0eb38d0d3de3f01188488eee0b1519e3f8aeabc2ab77 not found: ID does not exist" Sep 10 17:50:28.869089 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.869068 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-clh7j"] Sep 10 17:50:28.871600 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.871580 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-clh7j"] Sep 10 17:50:28.994210 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.994184 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57904191-8d77-480c-9365-928825ba7e40" path="/var/lib/kubelet/pods/57904191-8d77-480c-9365-928825ba7e40/volumes" Sep 10 17:50:28.994403 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.994391 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be7b1f33-f79e-4124-9b94-f7358fbdb880" path="/var/lib/kubelet/pods/be7b1f33-f79e-4124-9b94-f7358fbdb880/volumes" Sep 10 17:50:28.994581 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:50:28.994569 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7e228e8-aec9-4570-bbf5-a77a89fc6144" path="/var/lib/kubelet/pods/f7e228e8-aec9-4570-bbf5-a77a89fc6144/volumes" Sep 10 17:51:20.095889 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:20.095852 2580 generic.go:356] "Generic (PLEG): container finished" podID="fdbe1b87-6d50-46b8-b721-693b516f6e97" containerID="595d9c33138ffa6dcebc1d9c0d6196cc56f28b9ce23555f6df464bc96cde9ec0" exitCode=0 Sep 10 17:51:20.096314 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:20.095926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" event={"ID":"fdbe1b87-6d50-46b8-b721-693b516f6e97","Type":"ContainerDied","Data":"595d9c33138ffa6dcebc1d9c0d6196cc56f28b9ce23555f6df464bc96cde9ec0"} Sep 10 17:51:20.096356 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:20.096315 2580 scope.go:117] "RemoveContainer" containerID="595d9c33138ffa6dcebc1d9c0d6196cc56f28b9ce23555f6df464bc96cde9ec0" Sep 10 17:51:20.097288 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:20.097259 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:51:20.097382 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:20.097341 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:51:20.097440 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:20.097385 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 17:51:21.103452 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:21.103420 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" event={"ID":"fdbe1b87-6d50-46b8-b721-693b516f6e97","Type":"ContainerStarted","Data":"daba8917bd1e07d4da4fcda0528d534e7cb4ead2a1f2504147725e38d919e5bf"} Sep 10 17:51:21.736311 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:21.736278 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:51:21.736484 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:21.736440 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hzsxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Sep 10 17:51:21.736533 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:21.736482 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" podUID="fdbe1b87-6d50-46b8-b721-693b516f6e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Sep 10 17:51:22.736583 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:22.736547 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hzsxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Sep 10 17:51:22.736992 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:22.736611 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" podUID="fdbe1b87-6d50-46b8-b721-693b516f6e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Sep 10 17:51:23.736531 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:23.736499 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hzsxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Sep 10 17:51:23.736705 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:23.736549 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" podUID="fdbe1b87-6d50-46b8-b721-693b516f6e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Sep 10 17:51:24.736982 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:24.736948 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hzsxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Sep 10 17:51:24.737350 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:24.737003 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" podUID="fdbe1b87-6d50-46b8-b721-693b516f6e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Sep 10 17:51:25.736965 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:25.736927 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hzsxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Sep 10 17:51:25.737171 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:25.736989 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" podUID="fdbe1b87-6d50-46b8-b721-693b516f6e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Sep 10 17:51:26.740530 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:26.740501 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:51:26.740914 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:26.740868 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:51:26.741490 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:26.741470 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hzsxz" Sep 10 17:51:34.428377 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.428307 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4"] Sep 10 17:51:34.428703 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.428626 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7e228e8-aec9-4570-bbf5-a77a89fc6144" containerName="authorino" Sep 10 17:51:34.428703 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.428638 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7e228e8-aec9-4570-bbf5-a77a89fc6144" containerName="authorino" Sep 10 17:51:34.428770 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.428707 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7e228e8-aec9-4570-bbf5-a77a89fc6144" containerName="authorino" Sep 10 17:51:34.430617 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.430602 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.432730 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.432706 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 17:51:34.433231 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.433205 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 17:51:34.433347 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.433226 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 17:51:34.433347 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.433254 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g6mxf\"" Sep 10 17:51:34.443358 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.443339 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4"] Sep 10 17:51:34.524453 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.524419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.524606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.524456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjvtj\" (UniqueName: \"kubernetes.io/projected/03968884-f5e0-4c3c-aa5d-4a37c3f56460-kube-api-access-wjvtj\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.524606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.524488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03968884-f5e0-4c3c-aa5d-4a37c3f56460-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.524606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.524537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.524606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.524559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.524606 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.524602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.625758 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.625726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.625869 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.625758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvtj\" (UniqueName: \"kubernetes.io/projected/03968884-f5e0-4c3c-aa5d-4a37c3f56460-kube-api-access-wjvtj\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.625869 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.625789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03968884-f5e0-4c3c-aa5d-4a37c3f56460-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.625869 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.625844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.626055 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.626029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.626137 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.626123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.626206 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.626186 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.626340 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.626321 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.626436 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.626413 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.628103 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.628085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03968884-f5e0-4c3c-aa5d-4a37c3f56460-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.628189 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.628173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03968884-f5e0-4c3c-aa5d-4a37c3f56460-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.642851 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.642813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvtj\" (UniqueName: \"kubernetes.io/projected/03968884-f5e0-4c3c-aa5d-4a37c3f56460-kube-api-access-wjvtj\") pod \"e2e-distinct-simulated-kserve-6685d86975-8vjg4\" (UID: \"03968884-f5e0-4c3c-aa5d-4a37c3f56460\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:34.740854 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:34.740764 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:35.008541 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:35.008512 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4"] Sep 10 17:51:35.010146 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:51:35.010119 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03968884_f5e0_4c3c_aa5d_4a37c3f56460.slice/crio-384d176821d17b9701ee4deeffb9cdb343655d418e8f8a3387169e4c81a15610 WatchSource:0}: Error finding container 384d176821d17b9701ee4deeffb9cdb343655d418e8f8a3387169e4c81a15610: Status 404 returned error can't find the container with id 384d176821d17b9701ee4deeffb9cdb343655d418e8f8a3387169e4c81a15610 Sep 10 17:51:35.011444 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:35.011427 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:51:35.177542 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:35.177514 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" event={"ID":"03968884-f5e0-4c3c-aa5d-4a37c3f56460","Type":"ContainerStarted","Data":"384d176821d17b9701ee4deeffb9cdb343655d418e8f8a3387169e4c81a15610"} Sep 10 17:51:36.183863 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:36.183813 2580 generic.go:356] "Generic (PLEG): container finished" podID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" containerID="fb45bfa1bce093980d7515b970728c1681a346413179406293846cce3397fef9" exitCode=0 Sep 10 17:51:36.184185 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:36.183919 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" event={"ID":"03968884-f5e0-4c3c-aa5d-4a37c3f56460","Type":"ContainerDied","Data":"fb45bfa1bce093980d7515b970728c1681a346413179406293846cce3397fef9"} Sep 10 17:51:36.184185 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:36.184134 2580 scope.go:117] "RemoveContainer" containerID="fb45bfa1bce093980d7515b970728c1681a346413179406293846cce3397fef9" Sep 10 17:51:37.190346 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:37.190307 2580 generic.go:356] "Generic (PLEG): container finished" podID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" containerID="58daf53ee43b9515251117f6911151f12064fce8ebd0bffcc88db1d687813ae5" exitCode=0 Sep 10 17:51:37.190713 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:37.190381 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" event={"ID":"03968884-f5e0-4c3c-aa5d-4a37c3f56460","Type":"ContainerDied","Data":"58daf53ee43b9515251117f6911151f12064fce8ebd0bffcc88db1d687813ae5"} Sep 10 17:51:37.190713 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:37.190431 2580 scope.go:117] "RemoveContainer" containerID="fb45bfa1bce093980d7515b970728c1681a346413179406293846cce3397fef9" Sep 10 17:51:37.190713 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:37.190631 2580 scope.go:117] "RemoveContainer" containerID="58daf53ee43b9515251117f6911151f12064fce8ebd0bffcc88db1d687813ae5" Sep 10 17:51:37.190888 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:51:37.190863 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:51:38.197927 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:38.197901 2580 scope.go:117] "RemoveContainer" containerID="58daf53ee43b9515251117f6911151f12064fce8ebd0bffcc88db1d687813ae5" Sep 10 17:51:38.198288 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:51:38.198071 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:51:44.741653 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:44.741613 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:44.742205 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:44.741682 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:44.742205 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:44.741697 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:44.742205 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:44.741710 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:51:44.742205 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:44.742124 2580 scope.go:117] "RemoveContainer" containerID="58daf53ee43b9515251117f6911151f12064fce8ebd0bffcc88db1d687813ae5" Sep 10 17:51:44.742329 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:51:44.742273 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:51:53.308465 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.308435 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb"] Sep 10 17:51:53.311182 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.311166 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.313118 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.313095 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 17:51:53.319423 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.319401 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb"] Sep 10 17:51:53.387694 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.387670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.387811 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.387711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.387811 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.387729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9nm7\" (UniqueName: \"kubernetes.io/projected/940043cd-7e1c-4211-886b-00f03ecdc409-kube-api-access-g9nm7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.387811 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.387773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.387946 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.387848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.387946 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.387890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940043cd-7e1c-4211-886b-00f03ecdc409-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.488501 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.488472 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.488624 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.488507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9nm7\" (UniqueName: \"kubernetes.io/projected/940043cd-7e1c-4211-886b-00f03ecdc409-kube-api-access-g9nm7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.488624 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.488535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.488624 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.488574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.488779 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.488625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940043cd-7e1c-4211-886b-00f03ecdc409-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.488779 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.488695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.488971 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.488953 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.489034 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.489007 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.489090 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.489073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.490751 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.490734 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940043cd-7e1c-4211-886b-00f03ecdc409-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.491047 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.491026 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940043cd-7e1c-4211-886b-00f03ecdc409-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.495862 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.495842 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9nm7\" (UniqueName: \"kubernetes.io/projected/940043cd-7e1c-4211-886b-00f03ecdc409-kube-api-access-g9nm7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t47wb\" (UID: \"940043cd-7e1c-4211-886b-00f03ecdc409\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.621645 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.621617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:51:53.890432 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:53.890409 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb"] Sep 10 17:51:53.892289 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:51:53.892255 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940043cd_7e1c_4211_886b_00f03ecdc409.slice/crio-fda74a021aa039eb36092017beee142f27a60addcd25ce3e61094e2f5b22d10b WatchSource:0}: Error finding container fda74a021aa039eb36092017beee142f27a60addcd25ce3e61094e2f5b22d10b: Status 404 returned error can't find the container with id fda74a021aa039eb36092017beee142f27a60addcd25ce3e61094e2f5b22d10b Sep 10 17:51:54.282702 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:54.282618 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" event={"ID":"940043cd-7e1c-4211-886b-00f03ecdc409","Type":"ContainerStarted","Data":"4942afb921b278c0a0c68448bc5593beb388ad82c73ed983a25477c18130e3de"} Sep 10 17:51:54.282702 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:54.282667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" event={"ID":"940043cd-7e1c-4211-886b-00f03ecdc409","Type":"ContainerStarted","Data":"fda74a021aa039eb36092017beee142f27a60addcd25ce3e61094e2f5b22d10b"} Sep 10 17:51:54.301886 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:54.301845 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" podStartSLOduration=1.134885989 podStartE2EDuration="1.301831347s" totalImagesPullingTime="166.945358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:51:54.300585825 +0000 UTC m=+737.755172160" watchObservedRunningTime="2026-09-10 17:51:54.301831347 +0000 UTC m=+737.756417672" Sep 10 17:51:56.991865 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:56.991838 2580 scope.go:117] "RemoveContainer" containerID="58daf53ee43b9515251117f6911151f12064fce8ebd0bffcc88db1d687813ae5" Sep 10 17:51:57.300352 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:57.300294 2580 generic.go:356] "Generic (PLEG): container finished" podID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" containerID="b68867c87945257f5aa6d407e3e789e226535d5574d63702cdc005bf3f24c34b" exitCode=0 Sep 10 17:51:57.300442 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:57.300366 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" event={"ID":"03968884-f5e0-4c3c-aa5d-4a37c3f56460","Type":"ContainerDied","Data":"b68867c87945257f5aa6d407e3e789e226535d5574d63702cdc005bf3f24c34b"} Sep 10 17:51:57.300442 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:57.300423 2580 scope.go:117] "RemoveContainer" containerID="58daf53ee43b9515251117f6911151f12064fce8ebd0bffcc88db1d687813ae5" Sep 10 17:51:57.300706 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:51:57.300688 2580 scope.go:117] "RemoveContainer" containerID="b68867c87945257f5aa6d407e3e789e226535d5574d63702cdc005bf3f24c34b" Sep 10 17:51:57.300927 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:51:57.300907 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:52:03.621853 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:03.621803 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:52:03.622289 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:03.621881 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:52:03.634204 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:03.634178 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:52:04.349302 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:04.349276 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t47wb" Sep 10 17:52:04.741368 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:04.741332 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:04.741743 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:04.741393 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:04.741743 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:04.741409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:04.741743 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:04.741423 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:04.741871 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:04.741762 2580 scope.go:117] "RemoveContainer" containerID="b68867c87945257f5aa6d407e3e789e226535d5574d63702cdc005bf3f24c34b" Sep 10 17:52:04.741986 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:04.741962 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:52:19.989625 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:19.989583 2580 scope.go:117] "RemoveContainer" containerID="b68867c87945257f5aa6d407e3e789e226535d5574d63702cdc005bf3f24c34b" Sep 10 17:52:20.422316 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:20.422285 2580 generic.go:356] "Generic (PLEG): container finished" podID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" exitCode=0 Sep 10 17:52:20.422496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:20.422359 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" event={"ID":"03968884-f5e0-4c3c-aa5d-4a37c3f56460","Type":"ContainerDied","Data":"589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2"} Sep 10 17:52:20.422496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:20.422416 2580 scope.go:117] "RemoveContainer" containerID="b68867c87945257f5aa6d407e3e789e226535d5574d63702cdc005bf3f24c34b" Sep 10 17:52:20.422772 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:20.422749 2580 scope.go:117] "RemoveContainer" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" Sep 10 17:52:20.422996 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:20.422977 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:52:23.303355 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.303324 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr"] Sep 10 17:52:23.306148 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.306123 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.308091 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.308069 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 17:52:23.320469 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.320447 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr"] Sep 10 17:52:23.353758 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.353724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.353944 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.353763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf4zr\" (UniqueName: \"kubernetes.io/projected/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-kube-api-access-wf4zr\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.353944 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.353784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.353944 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.353877 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.353944 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.353905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.353944 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.353925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455006 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.454974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455006 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf4zr\" (UniqueName: \"kubernetes.io/projected/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-kube-api-access-wf4zr\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455270 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455270 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455270 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455270 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455488 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455459 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455488 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.455569 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.455532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.457258 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.457228 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.457477 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.457460 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.462014 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.461989 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf4zr\" (UniqueName: \"kubernetes.io/projected/e2ba82b1-984b-4d2d-ad1b-e3159ba15d55-kube-api-access-wf4zr\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr\" (UID: \"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.615268 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.615174 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:23.903118 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:23.903090 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr"] Sep 10 17:52:23.904752 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:52:23.904702 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2ba82b1_984b_4d2d_ad1b_e3159ba15d55.slice/crio-2309565700bcacfc0445573d58b3e1d20f54008d0d776f87322f5ddbd075227c WatchSource:0}: Error finding container 2309565700bcacfc0445573d58b3e1d20f54008d0d776f87322f5ddbd075227c: Status 404 returned error can't find the container with id 2309565700bcacfc0445573d58b3e1d20f54008d0d776f87322f5ddbd075227c Sep 10 17:52:24.446230 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.446205 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" containerID="0ab35d30a7ac0d29bd9e232befba50660c0d6bd18ff7e4cdbc3f9fc9e46b8677" exitCode=0 Sep 10 17:52:24.446592 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.446290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" event={"ID":"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55","Type":"ContainerDied","Data":"0ab35d30a7ac0d29bd9e232befba50660c0d6bd18ff7e4cdbc3f9fc9e46b8677"} Sep 10 17:52:24.446592 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.446328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" event={"ID":"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55","Type":"ContainerStarted","Data":"2309565700bcacfc0445573d58b3e1d20f54008d0d776f87322f5ddbd075227c"} Sep 10 17:52:24.446592 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.446494 2580 scope.go:117] "RemoveContainer" containerID="0ab35d30a7ac0d29bd9e232befba50660c0d6bd18ff7e4cdbc3f9fc9e46b8677" Sep 10 17:52:24.741222 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.741165 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:24.741222 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.741220 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:24.741353 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.741239 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:24.741353 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.741251 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:52:24.741598 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:24.741586 2580 scope.go:117] "RemoveContainer" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" Sep 10 17:52:24.741755 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:24.741740 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:52:25.452675 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:25.452642 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" containerID="c3ae54609b19d1abfd4054f06dc863f775881c26fed219b658739e2eed80878b" exitCode=0 Sep 10 17:52:25.453119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:25.452724 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" event={"ID":"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55","Type":"ContainerDied","Data":"c3ae54609b19d1abfd4054f06dc863f775881c26fed219b658739e2eed80878b"} Sep 10 17:52:25.453119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:25.452767 2580 scope.go:117] "RemoveContainer" containerID="0ab35d30a7ac0d29bd9e232befba50660c0d6bd18ff7e4cdbc3f9fc9e46b8677" Sep 10 17:52:25.453119 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:25.452976 2580 scope.go:117] "RemoveContainer" containerID="c3ae54609b19d1abfd4054f06dc863f775881c26fed219b658739e2eed80878b" Sep 10 17:52:25.453232 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:25.453159 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:52:26.466543 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:26.466513 2580 scope.go:117] "RemoveContainer" containerID="c3ae54609b19d1abfd4054f06dc863f775881c26fed219b658739e2eed80878b" Sep 10 17:52:26.466906 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:26.466767 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:52:33.615551 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:33.615512 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:33.615551 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:33.615561 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:33.616076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:33.615572 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:33.616076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:33.615581 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:33.616076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:33.615991 2580 scope.go:117] "RemoveContainer" containerID="c3ae54609b19d1abfd4054f06dc863f775881c26fed219b658739e2eed80878b" Sep 10 17:52:33.616171 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:33.616155 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:52:35.989761 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:35.989726 2580 scope.go:117] "RemoveContainer" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" Sep 10 17:52:35.990178 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:35.989957 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:52:47.989740 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:47.989713 2580 scope.go:117] "RemoveContainer" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" Sep 10 17:52:47.990129 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:47.989871 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:52:48.989459 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:48.989426 2580 scope.go:117] "RemoveContainer" containerID="c3ae54609b19d1abfd4054f06dc863f775881c26fed219b658739e2eed80878b" Sep 10 17:52:49.577595 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:49.577503 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" containerID="e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280" exitCode=0 Sep 10 17:52:49.577595 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:49.577578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" event={"ID":"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55","Type":"ContainerDied","Data":"e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280"} Sep 10 17:52:49.578141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:49.577628 2580 scope.go:117] "RemoveContainer" containerID="c3ae54609b19d1abfd4054f06dc863f775881c26fed219b658739e2eed80878b" Sep 10 17:52:49.578141 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:49.578053 2580 scope.go:117] "RemoveContainer" containerID="e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280" Sep 10 17:52:49.578274 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:49.578254 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:52:53.615724 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:53.615691 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:53.615724 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:53.615732 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:53.616202 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:53.615764 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:53.616202 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:53.615792 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:52:53.616202 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:53.616062 2580 scope.go:117] "RemoveContainer" containerID="e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280" Sep 10 17:52:53.616326 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:53.616216 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:52:54.604490 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:54.604460 2580 scope.go:117] "RemoveContainer" containerID="e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280" Sep 10 17:52:54.604660 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:54.604630 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:52:59.989842 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:52:59.989745 2580 scope.go:117] "RemoveContainer" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" Sep 10 17:52:59.990207 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:52:59.989927 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:53:06.991522 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:06.991487 2580 scope.go:117] "RemoveContainer" containerID="e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280" Sep 10 17:53:06.992121 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:06.991682 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:53:13.989059 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:13.989029 2580 scope.go:117] "RemoveContainer" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" Sep 10 17:53:14.704789 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.704761 2580 generic.go:356] "Generic (PLEG): container finished" podID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" exitCode=0 Sep 10 17:53:14.704966 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.704841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" event={"ID":"03968884-f5e0-4c3c-aa5d-4a37c3f56460","Type":"ContainerDied","Data":"98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f"} Sep 10 17:53:14.704966 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.704905 2580 scope.go:117] "RemoveContainer" containerID="589ae0ece8cc1a3bbe4f1eb6dbd0ee394eac20921d2fd556fb638da3bd216cc2" Sep 10 17:53:14.705207 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.705178 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:53:14.705392 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:14.705370 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:53:14.741130 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.741105 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:53:14.741259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.741173 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:53:14.741259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.741202 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:53:14.741259 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:14.741224 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:53:15.712556 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:15.712529 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:53:15.712941 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:15.712700 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:53:16.717951 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:16.717922 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:53:16.718331 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:16.718110 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:53:17.989664 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:17.989635 2580 scope.go:117] "RemoveContainer" containerID="e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280" Sep 10 17:53:18.735737 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:18.735701 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" containerID="607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef" exitCode=0 Sep 10 17:53:18.735945 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:18.735769 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" event={"ID":"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55","Type":"ContainerDied","Data":"607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef"} Sep 10 17:53:18.735945 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:18.735827 2580 scope.go:117] "RemoveContainer" containerID="e438ab114c0ce675fa6558d7a0e7066ccf66b8f9bb5ae5f59bb842f47bd30280" Sep 10 17:53:18.736152 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:18.736134 2580 scope.go:117] "RemoveContainer" containerID="607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef" Sep 10 17:53:18.736350 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:18.736329 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:53:23.616015 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:23.615978 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:53:23.616407 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:23.616027 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:53:23.616407 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:23.616038 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:53:23.616407 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:23.616047 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:53:23.616407 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:23.616352 2580 scope.go:117] "RemoveContainer" containerID="607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef" Sep 10 17:53:23.616563 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:23.616498 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:53:31.989374 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:31.989340 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:53:31.989771 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:31.989524 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:53:38.988906 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:38.988872 2580 scope.go:117] "RemoveContainer" containerID="607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef" Sep 10 17:53:38.989365 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:38.989033 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:53:46.991506 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:46.991480 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:53:46.991927 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:46.991664 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:53:52.989874 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:52.989839 2580 scope.go:117] "RemoveContainer" containerID="607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef" Sep 10 17:53:52.990493 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:52.990080 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:53:58.989545 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:53:58.989515 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:53:58.989978 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:53:58.989681 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:54:03.989007 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:03.988976 2580 scope.go:117] "RemoveContainer" containerID="607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef" Sep 10 17:54:04.971239 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:04.971202 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" exitCode=0 Sep 10 17:54:04.971437 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:04.971271 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" event={"ID":"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55","Type":"ContainerDied","Data":"2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364"} Sep 10 17:54:04.971437 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:04.971322 2580 scope.go:117] "RemoveContainer" containerID="607776ee82d66cf44d5ba87b78a5c83c26307d2c1fcac2b947de8598ae2dddef" Sep 10 17:54:04.971710 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:04.971687 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:54:04.971924 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:04.971892 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:54:10.989213 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:10.989185 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:54:10.989776 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:10.989351 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:54:13.615643 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:13.615604 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:54:13.615643 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:13.615654 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:54:13.616071 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:13.615666 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:54:13.616071 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:13.615675 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:54:13.616071 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:13.615963 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:54:13.616168 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:13.616097 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:54:23.989346 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:23.989316 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:54:23.989741 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:23.989511 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:54:28.989230 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:28.989197 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:54:28.989683 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:28.989365 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:54:36.976285 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:36.976258 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:54:36.978503 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:36.978482 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq25t_80722620-c40f-4ad9-87ce-60d04131eb54/ovn-acl-logging/0.log" Sep 10 17:54:37.989272 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:37.989230 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:54:39.143841 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:39.143788 2580 generic.go:356] "Generic (PLEG): container finished" podID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" exitCode=0 Sep 10 17:54:39.144254 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:39.143851 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" event={"ID":"03968884-f5e0-4c3c-aa5d-4a37c3f56460","Type":"ContainerDied","Data":"58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189"} Sep 10 17:54:39.144254 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:39.143918 2580 scope.go:117] "RemoveContainer" containerID="98028aa4cc226afca5742474665187b7730ebab22e1e5edbb17d07f3b61dff3f" Sep 10 17:54:39.144356 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:39.144254 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:54:39.144466 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:39.144440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:54:41.989654 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:41.989622 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:54:41.990085 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:41.989784 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:54:44.741465 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:44.741429 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:54:44.741909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:44.741500 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:54:44.741909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:44.741524 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:54:44.741909 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:44.741544 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" Sep 10 17:54:44.742026 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:44.741942 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:54:44.742138 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:44.742118 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:54:56.991760 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:56.991733 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:54:56.992255 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:56.991908 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:54:59.989025 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:54:59.988990 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:54:59.989419 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:54:59.989185 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:55:11.989665 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:11.989628 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:55:11.990173 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:11.989781 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:55:13.989107 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:13.989070 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:55:13.989493 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:13.989225 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:55:24.989113 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:24.989071 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:55:24.989518 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:24.989247 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:55:24.989518 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:24.989313 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:55:25.371145 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:25.371117 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" exitCode=0 Sep 10 17:55:25.371286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:25.371167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" event={"ID":"e2ba82b1-984b-4d2d-ad1b-e3159ba15d55","Type":"ContainerDied","Data":"58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17"} Sep 10 17:55:25.371286 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:25.371203 2580 scope.go:117] "RemoveContainer" containerID="2c405dffa8e4c794e955fb2d80c3729e0d75b63400a07d4180f9102edfd68364" Sep 10 17:55:25.371528 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:25.371511 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:55:25.371688 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:25.371669 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:55:33.615414 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:33.615380 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:55:33.615938 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:33.615433 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:55:33.615938 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:33.615451 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:55:33.615938 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:33.615463 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" Sep 10 17:55:33.615938 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:33.615883 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:55:33.616147 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:33.616079 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:55:37.989303 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:37.989270 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:55:37.989758 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:37.989486 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:55:45.989775 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:45.989745 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:55:45.990271 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:45.989912 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:55:51.989088 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:51.989053 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:55:51.989473 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:51.989235 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:55:56.991649 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:55:56.991617 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:55:56.992070 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:55:56.991854 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:56:04.989454 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:04.989377 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:56:04.989945 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:04.989550 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:56:09.989013 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:09.988980 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:56:09.989414 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:09.989140 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:56:17.988974 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:17.988944 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:56:17.989419 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:17.989111 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:56:20.989318 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:20.989287 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:56:20.991690 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:20.989429 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:56:25.665833 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:25.665782 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-674554c755-r2m54_d77dd4a1-9ffa-44cf-850c-d8898175e265/authorino/0.log" Sep 10 17:56:30.989498 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:30.989463 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:56:30.990011 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:30.989631 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:56:32.036871 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:32.036841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4_6aad801e-dc5d-4022-88d9-acd5bcaccd06/copy-manifests/0.log" Sep 10 17:56:32.044471 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:32.044445 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4_6aad801e-dc5d-4022-88d9-acd5bcaccd06/manager/0.log" Sep 10 17:56:33.337076 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:33.337040 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-674554c755-r2m54_d77dd4a1-9ffa-44cf-850c-d8898175e265/authorino/0.log" Sep 10 17:56:34.436659 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:34.436629 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5_df3e7f3f-4b2b-471b-a3e8-c3edcb100555/istio-proxy/0.log" Sep 10 17:56:34.821349 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:34.821263 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f88844dfb-xnx78_a8b003c1-846d-4c6b-92d4-e742e541bf45/kube-auth-proxy/0.log" Sep 10 17:56:34.946618 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:34.946580 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hzsxz_fdbe1b87-6d50-46b8-b721-693b516f6e97/istio-proxy/1.log" Sep 10 17:56:35.297255 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:35.297219 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bf59cb5f4-58bgz_afaf70a3-9531-4097-b4ff-bdd880fe0a81/router/0.log" Sep 10 17:56:35.770903 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:35.770872 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-8vjg4_03968884-f5e0-4c3c-aa5d-4a37c3f56460/main/5.log" Sep 10 17:56:35.988795 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:35.988765 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:56:35.988983 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:35.988957 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:56:36.007587 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:36.007558 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-t47wb_940043cd-7e1c-4211-886b-00f03ecdc409/main/0.log" Sep 10 17:56:36.355571 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:36.355544 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_e2ba82b1-984b-4d2d-ad1b-e3159ba15d55/main/5.log" Sep 10 17:56:41.989218 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:41.989188 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:56:41.989615 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:41.989355 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:56:42.047024 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.046991 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qq7nd/must-gather-tcp9l"] Sep 10 17:56:42.050167 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.050150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.052196 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.052172 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qq7nd\"/\"openshift-service-ca.crt\"" Sep 10 17:56:42.052423 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.052408 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qq7nd\"/\"default-dockercfg-9s2j2\"" Sep 10 17:56:42.052808 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.052792 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qq7nd\"/\"kube-root-ca.crt\"" Sep 10 17:56:42.065793 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.065770 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qq7nd/must-gather-tcp9l"] Sep 10 17:56:42.184755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.184716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1-must-gather-output\") pod \"must-gather-tcp9l\" (UID: \"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1\") " pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.184755 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.184751 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrlqn\" (UniqueName: \"kubernetes.io/projected/fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1-kube-api-access-lrlqn\") pod \"must-gather-tcp9l\" (UID: \"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1\") " pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.285978 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.285884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1-must-gather-output\") pod \"must-gather-tcp9l\" (UID: \"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1\") " pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.285978 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.285921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrlqn\" (UniqueName: \"kubernetes.io/projected/fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1-kube-api-access-lrlqn\") pod \"must-gather-tcp9l\" (UID: \"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1\") " pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.286246 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.286224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1-must-gather-output\") pod \"must-gather-tcp9l\" (UID: \"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1\") " pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.293086 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.293064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrlqn\" (UniqueName: \"kubernetes.io/projected/fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1-kube-api-access-lrlqn\") pod \"must-gather-tcp9l\" (UID: \"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1\") " pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.359300 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.359272 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qq7nd/must-gather-tcp9l" Sep 10 17:56:42.629614 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.629442 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qq7nd/must-gather-tcp9l"] Sep 10 17:56:42.631850 ip-10-0-129-36 kubenswrapper[2580]: W0910 17:56:42.631809 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd1ffd54_6076_4e74_b3a3_22f6ca9b22f1.slice/crio-4bb3605874bd8b529e0510143e7886d8e8525dfcd9cad0aab4bce056a086f3aa WatchSource:0}: Error finding container 4bb3605874bd8b529e0510143e7886d8e8525dfcd9cad0aab4bce056a086f3aa: Status 404 returned error can't find the container with id 4bb3605874bd8b529e0510143e7886d8e8525dfcd9cad0aab4bce056a086f3aa Sep 10 17:56:42.633725 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.633707 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:56:42.761622 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:42.761589 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qq7nd/must-gather-tcp9l" event={"ID":"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1","Type":"ContainerStarted","Data":"4bb3605874bd8b529e0510143e7886d8e8525dfcd9cad0aab4bce056a086f3aa"} Sep 10 17:56:43.770664 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:43.770565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qq7nd/must-gather-tcp9l" event={"ID":"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1","Type":"ContainerStarted","Data":"ff4b3567e084c7f7a06790d1a8062345e825789e3e74daf00b4017f655f17bd8"} Sep 10 17:56:43.770664 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:43.770614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qq7nd/must-gather-tcp9l" event={"ID":"fd1ffd54-6076-4e74-b3a3-22f6ca9b22f1","Type":"ContainerStarted","Data":"984155f8f651c564b10011b9cef495a72c513fcf41b2f4c09ac35c8cabb176d9"} Sep 10 17:56:43.788104 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:43.788039 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qq7nd/must-gather-tcp9l" podStartSLOduration=0.97812625 podStartE2EDuration="1.788016012s" totalImagesPullingTime="809.889762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:56:43.78521201 +0000 UTC m=+1027.239798347" watchObservedRunningTime="2026-09-10 17:56:43.788016012 +0000 UTC m=+1027.242602347" Sep 10 17:56:45.054012 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:45.053983 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qpkj2_113753c6-2d59-4206-a1f1-e16e2a56d33a/global-pull-secret-syncer/0.log" Sep 10 17:56:45.203991 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:45.203955 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dh5km_fa08cd90-0fe3-4cd3-a9b7-08436f5b51ef/konnectivity-agent/0.log" Sep 10 17:56:45.225801 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:45.225770 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-36.ec2.internal_35d4222d954e09fb211b132d5fc953a1/haproxy/0.log" Sep 10 17:56:47.989492 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:47.989460 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:56:47.990423 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:47.990396 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:56:49.726336 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:49.726305 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-674554c755-r2m54_d77dd4a1-9ffa-44cf-850c-d8898175e265/authorino/0.log" Sep 10 17:56:51.654416 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:51.654383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5559474478-sx6tj_0cb1c87b-47f4-4a03-891f-752a60980d66/metrics-server/0.log" Sep 10 17:56:51.868440 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:51.868404 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5v75_d9f6e299-6b4e-4f25-8999-2cfb40fb43ab/node-exporter/0.log" Sep 10 17:56:51.891946 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:51.891919 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5v75_d9f6e299-6b4e-4f25-8999-2cfb40fb43ab/kube-rbac-proxy/0.log" Sep 10 17:56:51.916758 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:51.916672 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5v75_d9f6e299-6b4e-4f25-8999-2cfb40fb43ab/init-textfile/0.log" Sep 10 17:56:54.107543 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.107514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-kmk69_d904b533-dca6-4546-a1a3-4e85c1caff35/networking-console-plugin/0.log" Sep 10 17:56:54.751926 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.751884 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh"] Sep 10 17:56:54.756446 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.756421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:54.770144 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.770119 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh"] Sep 10 17:56:54.918883 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.918847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-sys\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:54.919184 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.919161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-proc\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:54.919327 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.919309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-lib-modules\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:54.919485 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.919466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dzr\" (UniqueName: \"kubernetes.io/projected/da3c82fd-bae1-43ca-8f00-c4460c714ab3-kube-api-access-d6dzr\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:54.919659 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.919642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-podres\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:54.989368 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:54.989336 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:56:54.989593 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:56:54.989561 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:56:55.020471 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-sys\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020471 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-proc\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020471 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-lib-modules\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-sys\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dzr\" (UniqueName: \"kubernetes.io/projected/da3c82fd-bae1-43ca-8f00-c4460c714ab3-kube-api-access-d6dzr\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-proc\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-podres\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020743 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-lib-modules\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.020806 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.020795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da3c82fd-bae1-43ca-8f00-c4460c714ab3-podres\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.037648 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.037609 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dzr\" (UniqueName: \"kubernetes.io/projected/da3c82fd-bae1-43ca-8f00-c4460c714ab3-kube-api-access-d6dzr\") pod \"perf-node-gather-daemonset-z68mh\" (UID: \"da3c82fd-bae1-43ca-8f00-c4460c714ab3\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.069763 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.069727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.351547 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.351507 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh"] Sep 10 17:56:55.865447 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.865400 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" event={"ID":"da3c82fd-bae1-43ca-8f00-c4460c714ab3","Type":"ContainerStarted","Data":"a45a9cb68d0ed90fe943f374810c0e9ea588c1044670c6c1b5b287e07f050417"} Sep 10 17:56:55.865658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.865460 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" event={"ID":"da3c82fd-bae1-43ca-8f00-c4460c714ab3","Type":"ContainerStarted","Data":"66ecd815ed9244a5003665a1ee8794f5d15a693608a5e0e7e2f9a6eeca72f416"} Sep 10 17:56:55.865658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.865528 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:56:55.885185 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:55.885118 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" podStartSLOduration=1.8850956129999998 podStartE2EDuration="1.885095613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:56:55.881891926 +0000 UTC m=+1039.336478259" watchObservedRunningTime="2026-09-10 17:56:55.885095613 +0000 UTC m=+1039.339681946" Sep 10 17:56:56.211884 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:56.211849 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-prxhn_d86f8b3e-b713-40fd-bfa4-758114583bff/volume-data-source-validator/0.log" Sep 10 17:56:57.411515 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:57.411477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k2jpl_daa4ae8d-f32a-4dec-b25e-008beeddbc9a/dns/0.log" Sep 10 17:56:57.433947 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:57.433921 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k2jpl_daa4ae8d-f32a-4dec-b25e-008beeddbc9a/kube-rbac-proxy/0.log" Sep 10 17:56:57.492192 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:57.492160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lqnv_52a3092a-02fa-4419-bbd1-23e9045afcba/dns-node-resolver/0.log" Sep 10 17:56:58.142808 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:58.142768 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pxk7s_e443e321-aea0-4c13-8bf7-4eb60d3ff024/node-ca/0.log" Sep 10 17:56:59.145986 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:59.145945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5_df3e7f3f-4b2b-471b-a3e8-c3edcb100555/istio-proxy/0.log" Sep 10 17:56:59.275789 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:59.275758 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f88844dfb-xnx78_a8b003c1-846d-4c6b-92d4-e742e541bf45/kube-auth-proxy/0.log" Sep 10 17:56:59.320643 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:59.320611 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hzsxz_fdbe1b87-6d50-46b8-b721-693b516f6e97/istio-proxy/1.log" Sep 10 17:56:59.321098 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:59.321069 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hzsxz_fdbe1b87-6d50-46b8-b721-693b516f6e97/istio-proxy/0.log" Sep 10 17:56:59.420294 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:56:59.420217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bf59cb5f4-58bgz_afaf70a3-9531-4097-b4ff-bdd880fe0a81/router/0.log" Sep 10 17:57:00.082366 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:00.082326 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8fsr_04acc994-5125-44f9-9285-8262cd834126/serve-healthcheck-canary/0.log" Sep 10 17:57:00.612379 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:00.612345 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-7rpps_2b659243-0819-4245-b99c-32ddc6dfd8f3/insights-operator/1.log" Sep 10 17:57:00.612895 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:00.612525 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-7rpps_2b659243-0819-4245-b99c-32ddc6dfd8f3/insights-operator/0.log" Sep 10 17:57:00.636408 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:00.636381 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpmkl_4887adee-3910-430f-a228-94c0520c8b11/kube-rbac-proxy/0.log" Sep 10 17:57:00.659875 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:00.659811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpmkl_4887adee-3910-430f-a228-94c0520c8b11/exporter/0.log" Sep 10 17:57:00.685562 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:00.685526 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpmkl_4887adee-3910-430f-a228-94c0520c8b11/extractor/0.log" Sep 10 17:57:00.988999 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:00.988966 2580 scope.go:117] "RemoveContainer" containerID="58e7436241bb0a5b28621c9f5e3aed33d05d3acc60a26f7680dcc1549cb1ff17" Sep 10 17:57:00.989195 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:57:00.989171 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr_llm(e2ba82b1-984b-4d2d-ad1b-e3159ba15d55)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-4nlrr" podUID="e2ba82b1-984b-4d2d-ad1b-e3159ba15d55" Sep 10 17:57:01.882360 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:01.882313 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-z68mh" Sep 10 17:57:03.474985 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:03.474952 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4_6aad801e-dc5d-4022-88d9-acd5bcaccd06/manager/0.log" Sep 10 17:57:03.508199 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:03.508163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-s42f4_6aad801e-dc5d-4022-88d9-acd5bcaccd06/copy-manifests/0.log" Sep 10 17:57:04.989658 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:04.989631 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b786784bd-7nsdw_15052c22-b55c-4f8e-bf38-aa8df7952aaa/manager/0.log" Sep 10 17:57:05.194525 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:05.194499 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5_df3e7f3f-4b2b-471b-a3e8-c3edcb100555/istio-proxy/0.log" Sep 10 17:57:05.274685 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:05.274655 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f88844dfb-xnx78_a8b003c1-846d-4c6b-92d4-e742e541bf45/kube-auth-proxy/0.log" Sep 10 17:57:05.297885 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:05.297854 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hzsxz_fdbe1b87-6d50-46b8-b721-693b516f6e97/istio-proxy/1.log" Sep 10 17:57:05.298357 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:05.298333 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hzsxz_fdbe1b87-6d50-46b8-b721-693b516f6e97/istio-proxy/0.log" Sep 10 17:57:05.347873 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:05.347767 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bf59cb5f4-58bgz_afaf70a3-9531-4097-b4ff-bdd880fe0a81/router/0.log" Sep 10 17:57:06.479734 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:06.479702 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-79sc5_df3e7f3f-4b2b-471b-a3e8-c3edcb100555/istio-proxy/0.log" Sep 10 17:57:06.584410 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:06.584375 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f88844dfb-xnx78_a8b003c1-846d-4c6b-92d4-e742e541bf45/kube-auth-proxy/0.log" Sep 10 17:57:06.606882 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:06.606089 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hzsxz_fdbe1b87-6d50-46b8-b721-693b516f6e97/istio-proxy/0.log" Sep 10 17:57:06.611958 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:06.611932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hzsxz_fdbe1b87-6d50-46b8-b721-693b516f6e97/istio-proxy/1.log" Sep 10 17:57:06.667427 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:06.667393 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bf59cb5f4-58bgz_afaf70a3-9531-4097-b4ff-bdd880fe0a81/router/0.log" Sep 10 17:57:06.993759 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:06.993726 2580 scope.go:117] "RemoveContainer" containerID="58342aac15baafd2c8c1e22b29429e2f1c8c4e637085fa529a0c392a5d615189" Sep 10 17:57:06.994025 ip-10-0-129-36 kubenswrapper[2580]: E0910 17:57:06.993997 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-8vjg4_llm(03968884-f5e0-4c3c-aa5d-4a37c3f56460)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-8vjg4" podUID="03968884-f5e0-4c3c-aa5d-4a37c3f56460" Sep 10 17:57:11.689058 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:11.688979 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bv6sf_fd07c282-9396-45a4-b27a-284f438672b6/kube-multus-additional-cni-plugins/0.log" Sep 10 17:57:11.712496 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:11.712459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bv6sf_fd07c282-9396-45a4-b27a-284f438672b6/egress-router-binary-copy/0.log" Sep 10 17:57:11.734670 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:11.734642 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bv6sf_fd07c282-9396-45a4-b27a-284f438672b6/cni-plugins/0.log" Sep 10 17:57:11.756471 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:11.756446 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bv6sf_fd07c282-9396-45a4-b27a-284f438672b6/bond-cni-plugin/0.log" Sep 10 17:57:11.782509 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:11.782478 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bv6sf_fd07c282-9396-45a4-b27a-284f438672b6/routeoverride-cni/0.log" Sep 10 17:57:11.804868 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:11.804809 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bv6sf_fd07c282-9396-45a4-b27a-284f438672b6/whereabouts-cni-bincopy/0.log" Sep 10 17:57:11.827497 ip-10-0-129-36 kubenswrapper[2580]: I0910 17:57:11.827414 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bv6sf_fd07c282-9396-45a4-b27a-284f438672b6/whereabouts-cni/0.log"