Sep 10 17:23:51.836496 ip-10-0-131-138 systemd[1]: Starting Kubernetes Kubelet... Sep 10 17:23:52.204081 ip-10-0-131-138 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:23:52.204081 ip-10-0-131-138 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 17:23:52.204081 ip-10-0-131-138 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:23:52.204081 ip-10-0-131-138 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 17:23:52.204081 ip-10-0-131-138 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:23:52.206304 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.206239 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 17:23:52.211555 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211540 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:23:52.211555 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211555 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:23:52.211555 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211558 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211561 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211564 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211567 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211570 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211572 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211576 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211578 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211582 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211586 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211589 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211592 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211595 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211599 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211601 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211604 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211606 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211610 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211612 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211615 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:23:52.211685 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211618 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211620 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211622 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211625 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211627 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211630 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211632 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211635 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211637 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211640 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211642 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211645 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211647 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211649 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211653 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211656 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211658 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211661 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211664 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211667 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:23:52.212161 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211670 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211672 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211674 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211677 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211679 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211682 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211685 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211688 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211691 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211694 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211697 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211699 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211702 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211704 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211707 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211710 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211712 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211714 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211717 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211720 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:23:52.212657 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211722 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211725 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211729 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211732 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211734 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211737 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211740 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211743 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211746 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211749 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211751 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211754 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211756 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211759 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211761 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211763 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211767 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211769 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211772 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:23:52.213140 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211774 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211778 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211782 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211785 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211787 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211790 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211792 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211795 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211797 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211800 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211802 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211807 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211809 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211812 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211814 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211817 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211819 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.211822 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212533 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212539 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:23:52.213603 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212542 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212545 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212548 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212550 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212553 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212555 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212559 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212561 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212564 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212566 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212569 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212571 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212573 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212576 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212578 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212581 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212584 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212586 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212589 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212591 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:23:52.214065 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212593 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212596 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212598 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212604 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212606 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212609 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212611 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212613 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212617 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212621 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212624 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212627 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212630 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212633 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212636 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212639 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212642 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212644 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212647 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212649 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:23:52.214598 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212652 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212654 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212657 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212661 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212664 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212666 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212669 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212672 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212674 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212677 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212679 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212682 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212685 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212687 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212690 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212694 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212696 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212698 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212701 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:23:52.215080 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212705 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212708 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212711 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212714 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212716 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212719 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212721 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212723 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212726 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212728 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212730 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212733 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212735 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212737 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212740 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212742 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212744 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212747 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212749 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212752 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:23:52.215553 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212754 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212757 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212759 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212776 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212780 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212783 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212785 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212788 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212791 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212793 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212796 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212798 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212800 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212803 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212805 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212808 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212811 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.212813 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213146 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213150 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:23:52.216027 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213153 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213156 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213159 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213162 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213165 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213167 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213170 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213173 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213176 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213179 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213181 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213184 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213186 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213189 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213192 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213195 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213198 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213200 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213203 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213205 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:23:52.216518 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213208 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213210 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213213 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213215 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213218 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213234 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213237 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213240 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213243 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213246 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213249 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213252 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213256 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213258 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213261 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213264 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213266 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213269 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:23:52.216994 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213273 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213276 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213279 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213282 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213285 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213288 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213291 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213293 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213296 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213299 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213302 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213305 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213309 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213312 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213315 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213317 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213320 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213323 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213326 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213328 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:23:52.217450 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213331 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213334 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213336 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213339 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213342 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213344 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213347 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213349 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213352 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213354 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213358 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213361 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213364 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213367 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213372 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213374 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213377 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213379 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213382 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:23:52.217923 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213385 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213388 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213390 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213392 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213396 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213398 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213402 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213405 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213407 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213410 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213412 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213415 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213417 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213420 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213422 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213425 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213428 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213430 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213433 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.213435 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:23:52.218487 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213515 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213556 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213563 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213567 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213571 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213574 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213578 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213583 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213586 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213589 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213592 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213595 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213598 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213601 2580 flags.go:64] FLAG: --cgroup-root="" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213604 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213607 2580 flags.go:64] FLAG: --client-ca-file="" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213610 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213613 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213617 2580 flags.go:64] FLAG: --cluster-domain="" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213620 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213623 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213626 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213630 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213633 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 17:23:52.218958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213636 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213639 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213642 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213645 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213648 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213651 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213654 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213657 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213660 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213663 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213666 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213669 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213671 2580 flags.go:64] FLAG: --enable-server="true" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213674 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213679 2580 flags.go:64] FLAG: --event-burst="100" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213682 2580 flags.go:64] FLAG: --event-qps="50" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213685 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213688 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213691 2580 flags.go:64] FLAG: --eviction-hard="" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213694 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213697 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213700 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213702 2580 flags.go:64] FLAG: --eviction-soft="" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213705 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213708 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 17:23:52.219610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213711 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213714 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213717 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213720 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213723 2580 flags.go:64] FLAG: --feature-gates="" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213726 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213729 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213732 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213735 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213738 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213741 2580 flags.go:64] FLAG: --help="false" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213743 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213746 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213749 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213752 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213755 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213758 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213760 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213763 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213766 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213768 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213771 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213775 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213778 2580 flags.go:64] FLAG: --kube-reserved="" Sep 10 17:23:52.220509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213780 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213783 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213786 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213789 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213792 2580 flags.go:64] FLAG: --lock-file="" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213795 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213798 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213802 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213807 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213810 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213813 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213815 2580 flags.go:64] FLAG: --logging-format="text" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213818 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213821 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213824 2580 flags.go:64] FLAG: --manifest-url="" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213826 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213830 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213833 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213837 2580 flags.go:64] FLAG: --max-pods="110" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213839 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213842 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213845 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213847 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213850 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213853 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 17:23:52.221509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213856 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213862 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213865 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213868 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213871 2580 flags.go:64] FLAG: --pod-cidr="" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213874 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213879 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213882 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213885 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213888 2580 flags.go:64] FLAG: --port="10250" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213890 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213893 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e81a008de7a35bfa" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213896 2580 flags.go:64] FLAG: --qos-reserved="" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213899 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213903 2580 flags.go:64] FLAG: --register-node="true" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213905 2580 flags.go:64] FLAG: --register-with-taints="" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213909 2580 flags.go:64] FLAG: --registry-burst="10" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213911 2580 flags.go:64] FLAG: --registry-qps="5" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213917 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213920 2580 flags.go:64] FLAG: --reserved-memory="" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213924 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213926 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213929 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213932 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213935 2580 flags.go:64] FLAG: --runonce="false" Sep 10 17:23:52.222343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213938 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213940 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213943 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213947 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213949 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213953 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213955 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213958 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213961 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213964 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213966 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213969 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213972 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213976 2580 flags.go:64] FLAG: --system-cgroups="" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213979 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213984 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213987 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213989 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213993 2580 flags.go:64] FLAG: --tls-min-version="" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213996 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.213999 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214002 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214005 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214008 2580 flags.go:64] FLAG: --v="2" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214012 2580 flags.go:64] FLAG: --version="false" Sep 10 17:23:52.222944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214019 2580 flags.go:64] FLAG: --vmodule="" Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214024 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214027 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214130 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214135 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214139 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214151 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214154 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214157 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214160 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214163 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214166 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214169 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214171 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214174 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214176 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214179 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214182 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214184 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:23:52.223655 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214187 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214191 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214193 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214196 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214199 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214201 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214205 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214208 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214211 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214215 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214218 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214232 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214235 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214237 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214240 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214243 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214246 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214249 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214251 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214254 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:23:52.224133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214256 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214259 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214262 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214264 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214267 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214269 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214272 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214274 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214277 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214279 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214282 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214284 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214287 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214290 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214293 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214295 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214300 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214303 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214306 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214309 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:23:52.224631 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214312 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214315 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214318 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214320 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214323 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214325 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214328 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214330 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214333 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214336 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214338 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214340 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214343 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214345 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214348 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214350 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214352 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214355 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214357 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214360 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:23:52.225112 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214362 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214364 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214367 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214369 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214372 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214376 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214378 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214381 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214383 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214386 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214388 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214391 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214393 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214397 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214399 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214402 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214404 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214407 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214409 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:23:52.225610 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214412 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214414 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214417 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.214419 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.214749 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.223007 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.223021 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.223041 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.223047 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223102 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223106 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223109 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223113 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223115 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223118 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:23:52.226076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223121 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223124 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223127 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223129 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223133 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223138 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223141 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223144 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223147 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223149 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223153 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223156 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223158 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223161 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223163 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223166 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223168 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223171 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223173 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223176 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:23:52.226468 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223178 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223181 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223184 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223188 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223191 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223205 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223208 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223211 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223214 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223217 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223236 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223240 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223243 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223246 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223249 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223251 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223254 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223256 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223258 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:23:52.226944 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223261 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223264 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223267 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223269 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223272 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223275 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223277 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223281 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223284 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223287 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223290 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223293 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223295 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223297 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223300 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223303 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223306 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223309 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223311 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:23:52.227466 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223314 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223317 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223319 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223322 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223324 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223327 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223329 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223332 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223334 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223337 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223339 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223341 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223344 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223346 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223348 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223352 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223354 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223357 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223359 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223361 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:23:52.227914 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223364 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223366 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223368 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223371 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223373 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223376 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223378 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223381 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223384 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223387 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223389 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223392 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223394 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223397 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223399 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:23:52.228402 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.223405 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223513 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223517 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223520 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223523 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223526 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223529 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223531 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223534 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223536 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223539 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223541 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223544 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223547 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223550 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223554 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223557 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223559 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223562 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223565 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:23:52.228766 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223567 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223569 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223572 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223575 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223578 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223580 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223583 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223586 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223588 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223590 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223593 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223595 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223599 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223602 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223605 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223608 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223610 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223613 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223616 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223618 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:23:52.229252 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223621 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223624 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223626 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223629 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223631 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223633 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223636 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223639 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223642 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223644 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223647 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223649 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223652 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223654 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223656 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223659 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223662 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223664 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223667 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223670 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:23:52.229722 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223672 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223675 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223677 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223680 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223682 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223684 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223687 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223689 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223692 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223695 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223699 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223702 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223704 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223707 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223709 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223712 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223714 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223716 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223719 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223722 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:23:52.230196 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223725 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223727 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223730 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223732 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223734 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223737 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223739 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223742 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223744 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223747 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223749 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223752 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223754 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223757 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223759 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223762 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223764 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223766 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223769 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:23:52.230687 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:52.223771 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:23:52.231157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.223776 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:23:52.231157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.223864 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 17:23:52.231157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.225881 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 17:23:52.231157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.226667 2580 server.go:1019] "Starting client certificate rotation" Sep 10 17:23:52.231157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.226760 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:23:52.231157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.226791 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:23:52.231157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.228865 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:23:52.233913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.233900 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:23:52.245120 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.245101 2580 log.go:25] "Validated CRI v1 runtime API" Sep 10 17:23:52.248187 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.248173 2580 log.go:25] "Validated CRI v1 image API" Sep 10 17:23:52.249013 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.248999 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 17:23:52.252417 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.252390 2580 fs.go:135] Filesystem UUIDs: map[16f201ca-417c-4010-b0a5-5ab2833f88b2:/dev/nvme0n1p4 3b73e3d5-1165-4286-b7c8-46826c9228d4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 10 17:23:52.252501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.252416 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 17:23:52.257962 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.257616 2580 manager.go:216] Machine: {Timestamp:2026-09-10 17:23:52.256155334 +0000 UTC m=+0.308497324 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095845 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249fac0053c2a0e5192be81e628dfc SystemUUID:ec249fac-0053-c2a0-e519-2be81e628dfc BootID:233b47fe-d9ac-46a3-88ca-0a8488877931 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:34:b3:d5:c6:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:34:b3:d5:c6:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:bd:a9:2f:08:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 17:23:52.257962 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.257958 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 17:23:52.258077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.258057 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 17:23:52.259361 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.259345 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:23:52.259781 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.259760 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 17:23:52.259934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.259788 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 17:23:52.260962 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.260952 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 17:23:52.261000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.260965 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 17:23:52.261000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.260972 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:23:52.261519 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.261508 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:23:52.262754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.262744 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 17:23:52.265441 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265431 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:23:52.265556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265547 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 17:23:52.265591 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265576 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 10 17:23:52.265591 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265584 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 17:23:52.265646 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265602 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 17:23:52.265646 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265612 2580 kubelet.go:398] "Adding apiserver pod source" Sep 10 17:23:52.265646 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265620 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 17:23:52.265906 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265895 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:23:52.265953 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.265913 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:23:52.268366 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.268349 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 17:23:52.270351 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270338 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 17:23:52.270396 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270368 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 17:23:52.270528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270518 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 17:23:52.270556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270533 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 17:23:52.270556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270540 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 17:23:52.270556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270545 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 17:23:52.270556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270552 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 17:23:52.270556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.270556 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 17:23:52.271036 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.271028 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 17:23:52.271036 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.271036 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 17:23:52.271089 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.271043 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 17:23:52.271089 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.271048 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 17:23:52.271089 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.271063 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 17:23:52.271089 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.271070 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 17:23:52.272368 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.272358 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 17:23:52.272407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.272370 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 17:23:52.275810 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.275795 2580 server.go:1268] "Started kubelet" Sep 10 17:23:52.275867 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.275819 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 17:23:52.275934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.275910 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 17:23:52.276021 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.275976 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 17:23:52.276115 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.276037 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 17:23:52.276428 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.276402 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 17:23:52.276485 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.276410 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 17:23:52.276633 ip-10-0-131-138 systemd[1]: Started Kubernetes Kubelet. Sep 10 17:23:52.277317 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.277128 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 17:23:52.277877 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.277861 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 10 17:23:52.279814 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.279791 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 17:23:52.283422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.283404 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 17:23:52.284488 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.284473 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 17:23:52.284624 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.284606 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.285198 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285174 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvdzs" Sep 10 17:23:52.285198 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285190 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 17:23:52.285343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285194 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 17:23:52.285343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285234 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 17:23:52.285343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285309 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 10 17:23:52.285343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285319 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 10 17:23:52.285487 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.283883 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-138.ec2.internal.18d40587ae4a7f25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-138.ec2.internal,UID:ip-10-0-131-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-138.ec2.internal,},FirstTimestamp:2026-09-10 17:23:52.275771173 +0000 UTC m=+0.328113169,LastTimestamp:2026-09-10 17:23:52.275771173 +0000 UTC m=+0.328113169,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-138.ec2.internal,}" Sep 10 17:23:52.285566 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285555 2580 factory.go:153] Registering CRI-O factory Sep 10 17:23:52.285597 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285569 2580 factory.go:223] Registration of the crio container factory successfully Sep 10 17:23:52.285626 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285620 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 17:23:52.285663 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285627 2580 factory.go:55] Registering systemd factory Sep 10 17:23:52.285663 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285633 2580 factory.go:223] Registration of the systemd container factory successfully Sep 10 17:23:52.285663 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285644 2580 factory.go:103] Registering Raw factory Sep 10 17:23:52.285663 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.285653 2580 manager.go:1196] Started watching for new ooms in manager Sep 10 17:23:52.286025 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.286014 2580 manager.go:349] Starting recovery of all containers Sep 10 17:23:52.289462 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.289424 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 17:23:52.289647 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.289445 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 17:23:52.294381 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.294188 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 17:23:52.294749 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.294730 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvdzs" Sep 10 17:23:52.298905 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.298887 2580 manager.go:354] Recovery completed Sep 10 17:23:52.300529 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.300414 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 10 17:23:52.303418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.303405 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:23:52.305242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.305209 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:23:52.305300 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.305255 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:23:52.305300 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.305265 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:23:52.305788 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.305776 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 17:23:52.305788 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.305787 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 17:23:52.305854 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.305802 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:23:52.305854 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.305788 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:23:52.306484 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.306470 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:23:52.306549 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.306494 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:23:52.306549 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.306503 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:23:52.306866 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.306855 2580 policy_none.go:49] "None policy: Start" Sep 10 17:23:52.306899 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.306871 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 17:23:52.306899 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.306881 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 17:23:52.307711 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.307653 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-138.ec2.internal.18d40587b00c2df4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-138.ec2.internal,UID:ip-10-0-131-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-138.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-138.ec2.internal,},FirstTimestamp:2026-09-10 17:23:52.305241588 +0000 UTC m=+0.357583578,LastTimestamp:2026-09-10 17:23:52.305241588 +0000 UTC m=+0.357583578,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-138.ec2.internal,}" Sep 10 17:23:52.307977 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.307961 2580 policy_none.go:47] "Start" Sep 10 17:23:52.347807 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.347794 2580 manager.go:337] "Starting Device Plugin manager" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.347829 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.347842 2580 server.go:87] "Starting device plugin registration server" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.348116 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.348125 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.348282 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.348360 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.348369 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.349128 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 17:23:52.356670 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.349211 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.392771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.392748 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 17:23:52.392891 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.392794 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 17:23:52.392891 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.392834 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 17:23:52.392960 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.392893 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 17:23:52.396587 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.396569 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:23:52.449030 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.449012 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:23:52.449778 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.449763 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:23:52.449846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.449790 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:23:52.449846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.449801 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:23:52.449846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.449820 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.459960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.459898 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.459960 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.459931 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-138.ec2.internal\": node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.483394 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.483374 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.493518 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.493497 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal"] Sep 10 17:23:52.493568 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.493556 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:23:52.494709 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.494698 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:23:52.494761 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.494724 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:23:52.494761 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.494733 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:23:52.495766 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.495753 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:23:52.495876 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.495859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.495911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.495891 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:23:52.496454 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.496439 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:23:52.496528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.496470 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:23:52.496528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.496480 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:23:52.496528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.496500 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:23:52.496528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.496510 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:23:52.496658 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.496484 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:23:52.497669 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.497654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.497754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.497680 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:23:52.498418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.498402 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:23:52.498477 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.498428 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:23:52.498477 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.498443 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:23:52.525804 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.525781 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-138.ec2.internal\" not found" node="ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.530016 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.530002 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-138.ec2.internal\" not found" node="ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.584230 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.584210 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.585449 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.585434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/daf4ac3b2e491a7a3fc426c1e652891b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal\" (UID: \"daf4ac3b2e491a7a3fc426c1e652891b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.585516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.585456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daf4ac3b2e491a7a3fc426c1e652891b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal\" (UID: \"daf4ac3b2e491a7a3fc426c1e652891b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.585516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.585478 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66b6d9c8cad404e073ce8c64fcad27b9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-138.ec2.internal\" (UID: \"66b6d9c8cad404e073ce8c64fcad27b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.684583 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.684563 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.685682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.685667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66b6d9c8cad404e073ce8c64fcad27b9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-138.ec2.internal\" (UID: \"66b6d9c8cad404e073ce8c64fcad27b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.685736 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.685689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/daf4ac3b2e491a7a3fc426c1e652891b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal\" (UID: \"daf4ac3b2e491a7a3fc426c1e652891b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.685736 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.685705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daf4ac3b2e491a7a3fc426c1e652891b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal\" (UID: \"daf4ac3b2e491a7a3fc426c1e652891b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.685736 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.685729 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daf4ac3b2e491a7a3fc426c1e652891b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal\" (UID: \"daf4ac3b2e491a7a3fc426c1e652891b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.685875 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.685743 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66b6d9c8cad404e073ce8c64fcad27b9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-138.ec2.internal\" (UID: \"66b6d9c8cad404e073ce8c64fcad27b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.685875 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.685774 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/daf4ac3b2e491a7a3fc426c1e652891b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal\" (UID: \"daf4ac3b2e491a7a3fc426c1e652891b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.785572 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.785521 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.829765 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.829749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.832232 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:52.832205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:52.886205 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.886178 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:52.986548 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:52.986525 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:53.087006 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:53.086957 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:53.187332 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:53.187316 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:53.226701 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.226681 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 17:23:53.227059 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.226819 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:23:53.288145 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:53.288126 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-138.ec2.internal\" not found" Sep 10 17:23:53.300493 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.300472 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:23:53.300589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.300489 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 17:18:53 +0000 UTC" deadline="2028-04-10 08:04:10.763893033 +0000 UTC" Sep 10 17:23:53.300589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.300513 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13862h40m17.463383198s" Sep 10 17:23:53.301192 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:53.301173 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b6d9c8cad404e073ce8c64fcad27b9.slice/crio-8d768eb0db901689f00fc88802c0fe7b37eefc072fbc9701de01a32ed0c24d68 WatchSource:0}: Error finding container 8d768eb0db901689f00fc88802c0fe7b37eefc072fbc9701de01a32ed0c24d68: Status 404 returned error can't find the container with id 8d768eb0db901689f00fc88802c0fe7b37eefc072fbc9701de01a32ed0c24d68 Sep 10 17:23:53.304901 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.304881 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:23:53.307842 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:53.307822 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf4ac3b2e491a7a3fc426c1e652891b.slice/crio-6025dc827b812b7c28c1a4c6f0448910dd768298e22d863faaad11c928b6b341 WatchSource:0}: Error finding container 6025dc827b812b7c28c1a4c6f0448910dd768298e22d863faaad11c928b6b341: Status 404 returned error can't find the container with id 6025dc827b812b7c28c1a4c6f0448910dd768298e22d863faaad11c928b6b341 Sep 10 17:23:53.385923 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.385873 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" Sep 10 17:23:53.396600 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.396557 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" event={"ID":"daf4ac3b2e491a7a3fc426c1e652891b","Type":"ContainerStarted","Data":"6025dc827b812b7c28c1a4c6f0448910dd768298e22d863faaad11c928b6b341"} Sep 10 17:23:53.397200 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.397186 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:23:53.397560 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.397535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" event={"ID":"66b6d9c8cad404e073ce8c64fcad27b9","Type":"ContainerStarted","Data":"8d768eb0db901689f00fc88802c0fe7b37eefc072fbc9701de01a32ed0c24d68"} Sep 10 17:23:53.398993 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.398981 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" Sep 10 17:23:53.408062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.408044 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:23:53.409732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.409719 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:23:53.576577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:53.576555 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:23:55.072321 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.072291 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:23:55.299217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.299139 2580 apiserver.go:52] "Watching apiserver" Sep 10 17:23:55.306784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.306757 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 17:23:55.308009 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.307978 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-t4c8h","openshift-multus/network-metrics-daemon-vx8dz","openshift-network-operator/iptables-alerter-klj4b","openshift-ovn-kubernetes/ovnkube-node-fvmmd","kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84","openshift-cluster-node-tuning-operator/tuned-qvnft","openshift-dns/node-resolver-9bvpp","openshift-image-registry/node-ca-jp7bx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal","openshift-multus/multus-294nx","openshift-network-diagnostics/network-check-target-nnppj","kube-system/global-pull-secret-syncer-wbp2m","kube-system/konnectivity-agent-cmr5h"] Sep 10 17:23:55.309415 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.309397 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.310496 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.310477 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-294nx" Sep 10 17:23:55.311775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.311558 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:23:55.311775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.311588 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 17:23:55.311775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.311757 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7r266\"" Sep 10 17:23:55.312204 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.312181 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 17:23:55.312575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.312549 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 17:23:55.312575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.312565 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 17:23:55.312732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.312573 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-749sc\"" Sep 10 17:23:55.312732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.312565 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 17:23:55.312831 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.312776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.314677 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.314065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.315052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.315028 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 17:23:55.315168 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.315150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qgqgm\"" Sep 10 17:23:55.315168 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.315162 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 17:23:55.315278 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.315243 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:23:55.315809 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.315792 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.316338 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.316319 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 17:23:55.316589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.316568 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 17:23:55.316835 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.316819 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 17:23:55.316941 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.316913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 17:23:55.317314 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.317295 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.318354 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.318184 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nqlkp\"" Sep 10 17:23:55.318354 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.318245 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 17:23:55.318354 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.318282 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 17:23:55.319925 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.318962 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 17:23:55.319925 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.319425 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 17:23:55.319925 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.319779 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 17:23:55.320176 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.320142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.321491 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.320945 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 17:23:55.321491 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.321030 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ttrt7\"" Sep 10 17:23:55.321491 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.321147 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 17:23:55.321491 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.321343 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 17:23:55.321800 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.321712 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-brdfz\"" Sep 10 17:23:55.322690 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.322610 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 17:23:55.322778 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.322690 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 17:23:55.322778 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.322713 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 17:23:55.322886 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.322672 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sjxpm\"" Sep 10 17:23:55.322960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.322942 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.323168 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.323134 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:23:55.325202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.325053 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:55.325202 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.325122 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:23:55.326182 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.326166 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.327771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327751 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-ovn\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.327871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-conf-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.327871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327807 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-multus-certs\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.327871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7zgj\" (UniqueName: \"kubernetes.io/projected/381d0284-dcdf-460d-b6f1-48715caa3c5f-kube-api-access-w7zgj\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.327871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovnkube-script-lib\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-run\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-netns\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-cnibin\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327943 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysconfig\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-systemd\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.327990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-systemd\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-cni-netd\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8dsb\" (UniqueName: \"kubernetes.io/projected/84396190-5a37-4dca-a48b-cfff4bb5ef9c-kube-api-access-j8dsb\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.328073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-hostroot\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328094 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-etc-kubernetes\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbw6q\" (UniqueName: \"kubernetes.io/projected/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-kube-api-access-fbw6q\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f35879b-7d56-41ed-b169-88af090de606-cni-binary-copy\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-env-overrides\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328256 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovn-node-metrics-cert\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-socket-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-sys-fs\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328376 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328403 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-spzjl\"" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-sys\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.328472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-lib-modules\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-k8s-cni-cncf-io\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1d4809-08c3-4961-91c1-ac91158d616d-konnectivity-ca\") pod \"konnectivity-agent-cmr5h\" (UID: \"fd1d4809-08c3-4961-91c1-ac91158d616d\") " pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/381d0284-dcdf-460d-b6f1-48715caa3c5f-iptables-alerter-script\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-var-lib-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-log-socket\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysctl-d\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbwrb\" (UniqueName: \"kubernetes.io/projected/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-kube-api-access-xbwrb\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-systemd-units\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-serviceca\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysctl-conf\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-system-cni-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-cni-bin\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328896 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bccxj\" (UniqueName: \"kubernetes.io/projected/8f35879b-7d56-41ed-b169-88af090de606-kube-api-access-bccxj\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-socket-dir-parent\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.329105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/381d0284-dcdf-460d-b6f1-48715caa3c5f-host-slash\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.328984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-node-log\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hshbt\" (UniqueName: \"kubernetes.io/projected/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-kube-api-access-hshbt\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329031 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-device-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-kubernetes\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329078 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-var-lib-kubelet\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-kubelet\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-etc-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-tuned\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-tmp\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-cni-multus\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovnkube-config\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-host\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1d4809-08c3-4961-91c1-ac91158d616d-agent-certs\") pod \"konnectivity-agent-cmr5h\" (UID: \"fd1d4809-08c3-4961-91c1-ac91158d616d\") " pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-slash\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-modprobe-d\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-kubelet\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.329583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-run-netns\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-registration-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-cni-bin\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-host\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-cni-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.329448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f35879b-7d56-41ed-b169-88af090de606-multus-daemon-config\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.330102 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:55.330234 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.330159 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:23:55.330612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.330506 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 17:23:55.330612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.330605 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ktq8c\"" Sep 10 17:23:55.330745 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.330619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 17:23:55.333497 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.333475 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:23:55.382239 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.382213 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wl9vf" Sep 10 17:23:55.390161 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.390145 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wl9vf" Sep 10 17:23:55.418620 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.418599 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 17:23:55.430328 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430298 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7zgj\" (UniqueName: \"kubernetes.io/projected/381d0284-dcdf-460d-b6f1-48715caa3c5f-kube-api-access-w7zgj\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.430427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovnkube-script-lib\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.430427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-run\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.430427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-netns\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.430535 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-cnibin\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.430535 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.430535 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430499 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-run\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.430655 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.430655 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.430655 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-cnibin\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.430655 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysconfig\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.430814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430570 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-netns\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.430814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430667 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-cnibin\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.430814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-systemd\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.430814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430724 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysconfig\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.430814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430732 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-systemd\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.430814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-kubelet-config\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-systemd\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-cni-netd\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8dsb\" (UniqueName: \"kubernetes.io/projected/84396190-5a37-4dca-a48b-cfff4bb5ef9c-kube-api-access-j8dsb\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-hostroot\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-systemd\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430936 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-cni-netd\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-etc-kubernetes\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430985 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-hostroot\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.430996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbw6q\" (UniqueName: \"kubernetes.io/projected/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-kube-api-access-fbw6q\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f35879b-7d56-41ed-b169-88af090de606-cni-binary-copy\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431042 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-etc-kubernetes\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c93b03a1-a891-40ae-ac9e-b12918218e6b-tmp-dir\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-env-overrides\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovn-node-metrics-cert\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-socket-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431191 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-sys-fs\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431264 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-sys-fs\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431207 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovnkube-script-lib\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-sys\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-lib-modules\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431313 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-socket-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-k8s-cni-cncf-io\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431337 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1d4809-08c3-4961-91c1-ac91158d616d-konnectivity-ca\") pod \"konnectivity-agent-cmr5h\" (UID: \"fd1d4809-08c3-4961-91c1-ac91158d616d\") " pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431413 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431440 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-sys\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/381d0284-dcdf-460d-b6f1-48715caa3c5f-iptables-alerter-script\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-var-lib-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-log-socket\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431580 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-env-overrides\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysctl-d\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwrb\" (UniqueName: \"kubernetes.io/projected/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-kube-api-access-xbwrb\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-systemd-units\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431691 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f35879b-7d56-41ed-b169-88af090de606-cni-binary-copy\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-serviceca\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431725 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysctl-d\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysctl-conf\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-system-cni-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-cni-bin\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bccxj\" (UniqueName: \"kubernetes.io/projected/8f35879b-7d56-41ed-b169-88af090de606-kube-api-access-bccxj\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-sysctl-conf\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431892 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-var-lib-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.431991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431905 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-system-cni-dir\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-socket-dir-parent\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431972 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/381d0284-dcdf-460d-b6f1-48715caa3c5f-iptables-alerter-script\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431957 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/381d0284-dcdf-460d-b6f1-48715caa3c5f-host-slash\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432034 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-cni-bin\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-node-log\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hshbt\" (UniqueName: \"kubernetes.io/projected/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-kube-api-access-hshbt\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-device-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432121 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-kubernetes\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-var-lib-kubelet\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-kubelet\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-etc-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-tuned\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-tmp\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432099 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-lib-modules\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.432456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-cni-multus\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472g7\" (UniqueName: \"kubernetes.io/projected/b2636c52-57f6-452e-af71-f5dfe97c3335-kube-api-access-472g7\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432309 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-socket-dir-parent\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrcwv\" (UniqueName: \"kubernetes.io/projected/c93b03a1-a891-40ae-ac9e-b12918218e6b-kube-api-access-hrcwv\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovnkube-config\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-host\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432381 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/381d0284-dcdf-460d-b6f1-48715caa3c5f-host-slash\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1d4809-08c3-4961-91c1-ac91158d616d-agent-certs\") pod \"konnectivity-agent-cmr5h\" (UID: \"fd1d4809-08c3-4961-91c1-ac91158d616d\") " pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432436 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-node-log\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432489 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1d4809-08c3-4961-91c1-ac91158d616d-konnectivity-ca\") pod \"konnectivity-agent-cmr5h\" (UID: \"fd1d4809-08c3-4961-91c1-ac91158d616d\") " pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-slash\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432510 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-serviceca\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432542 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-systemd-units\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432596 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-k8s-cni-cncf-io\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432624 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-system-cni-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.433034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-modprobe-d\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-kubelet\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c93b03a1-a891-40ae-ac9e-b12918218e6b-hosts-file\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432794 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-device-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.431975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-log-socket\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-run-netns\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-run-netns\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-slash\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-registration-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrn4k\" (UniqueName: \"kubernetes.io/projected/5e1be7dd-da00-42e8-b73e-242d73795a4c-kube-api-access-mrn4k\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-cni-multus\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.432995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-cni-bin\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433003 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-host\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-etc-openvswitch\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.433938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433045 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84396190-5a37-4dca-a48b-cfff4bb5ef9c-registration-dir\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-cni-bin\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-kubernetes\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433142 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-var-lib-kubelet\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-host-kubelet\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433188 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-var-lib-kubelet\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433219 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-modprobe-d\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-host\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-cni-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-host\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433462 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-cni-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.433570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f35879b-7d56-41ed-b169-88af090de606-multus-daemon-config\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-dbus\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-ovn\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-conf-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-multus-certs\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.434654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434351 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-host-run-multus-certs\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.435554 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-run-ovn\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.435554 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.434921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovnkube-config\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.435554 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.435023 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f35879b-7d56-41ed-b169-88af090de606-multus-conf-dir\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.435715 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.435562 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f35879b-7d56-41ed-b169-88af090de606-multus-daemon-config\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.437120 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.437091 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-etc-tuned\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.439239 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.439166 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-ovn-node-metrics-cert\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.440176 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.440158 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-tmp\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.442508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.442483 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bccxj\" (UniqueName: \"kubernetes.io/projected/8f35879b-7d56-41ed-b169-88af090de606-kube-api-access-bccxj\") pod \"multus-294nx\" (UID: \"8f35879b-7d56-41ed-b169-88af090de606\") " pod="openshift-multus/multus-294nx" Sep 10 17:23:55.444339 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.444318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8dsb\" (UniqueName: \"kubernetes.io/projected/84396190-5a37-4dca-a48b-cfff4bb5ef9c-kube-api-access-j8dsb\") pod \"aws-ebs-csi-driver-node-jxf84\" (UID: \"84396190-5a37-4dca-a48b-cfff4bb5ef9c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.444667 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.444602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbw6q\" (UniqueName: \"kubernetes.io/projected/9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105-kube-api-access-fbw6q\") pod \"node-ca-jp7bx\" (UID: \"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105\") " pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.444942 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.444921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7zgj\" (UniqueName: \"kubernetes.io/projected/381d0284-dcdf-460d-b6f1-48715caa3c5f-kube-api-access-w7zgj\") pod \"iptables-alerter-klj4b\" (UID: \"381d0284-dcdf-460d-b6f1-48715caa3c5f\") " pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.445703 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.445680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hshbt\" (UniqueName: \"kubernetes.io/projected/ef9dccf3-b965-4f14-9eb9-94e21a83b8f6-kube-api-access-hshbt\") pod \"ovnkube-node-fvmmd\" (UID: \"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.445783 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.445682 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbwrb\" (UniqueName: \"kubernetes.io/projected/3970f00e-faf3-486e-aa5a-9e00e0cbfea2-kube-api-access-xbwrb\") pod \"tuned-qvnft\" (UID: \"3970f00e-faf3-486e-aa5a-9e00e0cbfea2\") " pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.447212 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.447185 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1d4809-08c3-4961-91c1-ac91158d616d-agent-certs\") pod \"konnectivity-agent-cmr5h\" (UID: \"fd1d4809-08c3-4961-91c1-ac91158d616d\") " pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.535060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrn4k\" (UniqueName: \"kubernetes.io/projected/5e1be7dd-da00-42e8-b73e-242d73795a4c-kube-api-access-mrn4k\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-dbus\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-cnibin\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-kubelet-config\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-dbus\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.535211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c93b03a1-a891-40ae-ac9e-b12918218e6b-tmp-dir\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.535222 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.535294 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:23:56.035269932 +0000 UTC m=+3.055197079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-system-cni-dir\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.535339 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472g7\" (UniqueName: \"kubernetes.io/projected/b2636c52-57f6-452e-af71-f5dfe97c3335-kube-api-access-472g7\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-cnibin\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.535386 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret podName:3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0 nodeName:}" failed. No retries permitted until 2026-09-10 17:23:56.035370217 +0000 UTC m=+3.055297362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret") pod "global-pull-secret-syncer-wbp2m" (UID: "3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535391 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-kubelet-config\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrcwv\" (UniqueName: \"kubernetes.io/projected/c93b03a1-a891-40ae-ac9e-b12918218e6b-kube-api-access-hrcwv\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e1be7dd-da00-42e8-b73e-242d73795a4c-system-cni-dir\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535487 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c93b03a1-a891-40ae-ac9e-b12918218e6b-tmp-dir\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.535694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c93b03a1-a891-40ae-ac9e-b12918218e6b-hosts-file\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.536309 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c93b03a1-a891-40ae-ac9e-b12918218e6b-hosts-file\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.536309 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.535707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.536309 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.536052 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.536309 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.536119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e1be7dd-da00-42e8-b73e-242d73795a4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.546248 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.546112 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:23:55.546248 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.546142 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:23:55.546248 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.546157 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ppxpm for pod openshift-network-diagnostics/network-check-target-nnppj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:55.546248 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:55.546221 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm podName:6abc33af-bfd3-4ff2-9f2d-ba83d562a91e nodeName:}" failed. No retries permitted until 2026-09-10 17:23:56.046204367 +0000 UTC m=+3.066131509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ppxpm" (UniqueName: "kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm") pod "network-check-target-nnppj" (UID: "6abc33af-bfd3-4ff2-9f2d-ba83d562a91e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:55.547681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.547657 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrn4k\" (UniqueName: \"kubernetes.io/projected/5e1be7dd-da00-42e8-b73e-242d73795a4c-kube-api-access-mrn4k\") pod \"multus-additional-cni-plugins-t4c8h\" (UID: \"5e1be7dd-da00-42e8-b73e-242d73795a4c\") " pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:55.550100 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.550043 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrcwv\" (UniqueName: \"kubernetes.io/projected/c93b03a1-a891-40ae-ac9e-b12918218e6b-kube-api-access-hrcwv\") pod \"node-resolver-9bvpp\" (UID: \"c93b03a1-a891-40ae-ac9e-b12918218e6b\") " pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.550962 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.550938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-472g7\" (UniqueName: \"kubernetes.io/projected/b2636c52-57f6-452e-af71-f5dfe97c3335-kube-api-access-472g7\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:55.621317 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.621287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvnft" Sep 10 17:23:55.628960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.628941 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-294nx" Sep 10 17:23:55.638777 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.638756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klj4b" Sep 10 17:23:55.642930 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.642913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:23:55.650392 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.650376 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:23:55.657893 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.657874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" Sep 10 17:23:55.665485 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.665467 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jp7bx" Sep 10 17:23:55.671945 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.671925 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bvpp" Sep 10 17:23:55.675848 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:55.675829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" Sep 10 17:23:56.039334 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.039238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:56.039334 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.039311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:56.039561 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.039426 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:56.039561 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.039451 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:56.039561 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.039505 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:23:57.039485157 +0000 UTC m=+4.059412288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:56.039561 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.039526 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret podName:3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0 nodeName:}" failed. No retries permitted until 2026-09-10 17:23:57.039516092 +0000 UTC m=+4.059443225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret") pod "global-pull-secret-syncer-wbp2m" (UID: "3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:56.140299 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.140090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:56.140299 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.140294 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:23:56.140467 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.140318 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:23:56.140467 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.140343 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ppxpm for pod openshift-network-diagnostics/network-check-target-nnppj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:56.140467 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.140414 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm podName:6abc33af-bfd3-4ff2-9f2d-ba83d562a91e nodeName:}" failed. No retries permitted until 2026-09-10 17:23:57.140395399 +0000 UTC m=+4.160322548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ppxpm" (UniqueName: "kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm") pod "network-check-target-nnppj" (UID: "6abc33af-bfd3-4ff2-9f2d-ba83d562a91e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:56.145418 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.145391 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93b03a1_a891_40ae_ac9e_b12918218e6b.slice/crio-4b0de3db1e812b243498473993d08a621c24c2f566fcd243063a699cc064480e WatchSource:0}: Error finding container 4b0de3db1e812b243498473993d08a621c24c2f566fcd243063a699cc064480e: Status 404 returned error can't find the container with id 4b0de3db1e812b243498473993d08a621c24c2f566fcd243063a699cc064480e Sep 10 17:23:56.146529 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.146435 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f35879b_7d56_41ed_b169_88af090de606.slice/crio-fad790735c1fd168b4ee36c729383f5cd616385d0d162d3bf8cbff2a2a9c4f80 WatchSource:0}: Error finding container fad790735c1fd168b4ee36c729383f5cd616385d0d162d3bf8cbff2a2a9c4f80: Status 404 returned error can't find the container with id fad790735c1fd168b4ee36c729383f5cd616385d0d162d3bf8cbff2a2a9c4f80 Sep 10 17:23:56.147355 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.147333 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9dccf3_b965_4f14_9eb9_94e21a83b8f6.slice/crio-5b1f8fa5928d1c691472a214278581bd732afbaa2799f2775a4d4fd0b122f8be WatchSource:0}: Error finding container 5b1f8fa5928d1c691472a214278581bd732afbaa2799f2775a4d4fd0b122f8be: Status 404 returned error can't find the container with id 5b1f8fa5928d1c691472a214278581bd732afbaa2799f2775a4d4fd0b122f8be Sep 10 17:23:56.148707 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.148689 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1be7dd_da00_42e8_b73e_242d73795a4c.slice/crio-c74ea8dbdd81d3fbcb44a9712340f1a14b3594d7de23d0eebc36c1bfc676c137 WatchSource:0}: Error finding container c74ea8dbdd81d3fbcb44a9712340f1a14b3594d7de23d0eebc36c1bfc676c137: Status 404 returned error can't find the container with id c74ea8dbdd81d3fbcb44a9712340f1a14b3594d7de23d0eebc36c1bfc676c137 Sep 10 17:23:56.151024 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.150997 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381d0284_dcdf_460d_b6f1_48715caa3c5f.slice/crio-35d02471ec27799e962972e98a11d835883d4065d7130f69cf2dba632c264cc5 WatchSource:0}: Error finding container 35d02471ec27799e962972e98a11d835883d4065d7130f69cf2dba632c264cc5: Status 404 returned error can't find the container with id 35d02471ec27799e962972e98a11d835883d4065d7130f69cf2dba632c264cc5 Sep 10 17:23:56.152569 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.152371 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84396190_5a37_4dca_a48b_cfff4bb5ef9c.slice/crio-ac5dddf1484dfe5a08a45e88fb503facfea4e650043859298efee407b1d72dbe WatchSource:0}: Error finding container ac5dddf1484dfe5a08a45e88fb503facfea4e650043859298efee407b1d72dbe: Status 404 returned error can't find the container with id ac5dddf1484dfe5a08a45e88fb503facfea4e650043859298efee407b1d72dbe Sep 10 17:23:56.153107 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.153027 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1d4809_08c3_4961_91c1_ac91158d616d.slice/crio-225341d7002ea511a24f4b5c548ec020a0683bce857c23b470a2a2cba2863a1c WatchSource:0}: Error finding container 225341d7002ea511a24f4b5c548ec020a0683bce857c23b470a2a2cba2863a1c: Status 404 returned error can't find the container with id 225341d7002ea511a24f4b5c548ec020a0683bce857c23b470a2a2cba2863a1c Sep 10 17:23:56.153583 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:23:56.153425 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d251a7f_bcd4_4da3_b8ce_7b0b9a0d3105.slice/crio-e4a89e97fb66d05849570810d8880e69877591445e817cc763cb2b2246c93d44 WatchSource:0}: Error finding container e4a89e97fb66d05849570810d8880e69877591445e817cc763cb2b2246c93d44: Status 404 returned error can't find the container with id e4a89e97fb66d05849570810d8880e69877591445e817cc763cb2b2246c93d44 Sep 10 17:23:56.391957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.391913 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:18:55 +0000 UTC" deadline="2028-02-15 18:05:50.199812451 +0000 UTC" Sep 10 17:23:56.391957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.391956 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12552h41m53.807858714s" Sep 10 17:23:56.426343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.426308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:56.426438 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:56.426407 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:23:56.441008 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.440979 2580 generic.go:356] "Generic (PLEG): container finished" podID="daf4ac3b2e491a7a3fc426c1e652891b" containerID="b217adaf20f0f99dac6f58e440316fa6075689818c474a6e16a0cccb599aa23f" exitCode=0 Sep 10 17:23:56.441110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.441060 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" event={"ID":"daf4ac3b2e491a7a3fc426c1e652891b","Type":"ContainerDied","Data":"b217adaf20f0f99dac6f58e440316fa6075689818c474a6e16a0cccb599aa23f"} Sep 10 17:23:56.442352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.442325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvnft" event={"ID":"3970f00e-faf3-486e-aa5a-9e00e0cbfea2","Type":"ContainerStarted","Data":"d9c69f5d547f837f09be0aa4e0988814580ed29a1ec5ef8b45b23a0d14965b9c"} Sep 10 17:23:56.443484 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.443458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" event={"ID":"84396190-5a37-4dca-a48b-cfff4bb5ef9c","Type":"ContainerStarted","Data":"ac5dddf1484dfe5a08a45e88fb503facfea4e650043859298efee407b1d72dbe"} Sep 10 17:23:56.444649 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.444616 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-294nx" event={"ID":"8f35879b-7d56-41ed-b169-88af090de606","Type":"ContainerStarted","Data":"fad790735c1fd168b4ee36c729383f5cd616385d0d162d3bf8cbff2a2a9c4f80"} Sep 10 17:23:56.445784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.445759 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bvpp" event={"ID":"c93b03a1-a891-40ae-ac9e-b12918218e6b","Type":"ContainerStarted","Data":"4b0de3db1e812b243498473993d08a621c24c2f566fcd243063a699cc064480e"} Sep 10 17:23:56.447082 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.447065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" event={"ID":"66b6d9c8cad404e073ce8c64fcad27b9","Type":"ContainerStarted","Data":"20ea854ceafc38a8a81545719f2cc2888aace05640843167c02d558a19e414e5"} Sep 10 17:23:56.448236 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.448216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jp7bx" event={"ID":"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105","Type":"ContainerStarted","Data":"e4a89e97fb66d05849570810d8880e69877591445e817cc763cb2b2246c93d44"} Sep 10 17:23:56.449351 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.449332 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cmr5h" event={"ID":"fd1d4809-08c3-4961-91c1-ac91158d616d","Type":"ContainerStarted","Data":"225341d7002ea511a24f4b5c548ec020a0683bce857c23b470a2a2cba2863a1c"} Sep 10 17:23:56.450381 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.450363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klj4b" event={"ID":"381d0284-dcdf-460d-b6f1-48715caa3c5f","Type":"ContainerStarted","Data":"35d02471ec27799e962972e98a11d835883d4065d7130f69cf2dba632c264cc5"} Sep 10 17:23:56.451439 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.451419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerStarted","Data":"c74ea8dbdd81d3fbcb44a9712340f1a14b3594d7de23d0eebc36c1bfc676c137"} Sep 10 17:23:56.452502 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:56.452481 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"5b1f8fa5928d1c691472a214278581bd732afbaa2799f2775a4d4fd0b122f8be"} Sep 10 17:23:57.047847 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.047807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:57.048008 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.047881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:57.048066 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.048021 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:57.048136 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.048084 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:23:59.048065506 +0000 UTC m=+6.067992639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:57.048196 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.048148 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:57.048196 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.048184 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret podName:3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0 nodeName:}" failed. No retries permitted until 2026-09-10 17:23:59.048172184 +0000 UTC m=+6.068099315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret") pod "global-pull-secret-syncer-wbp2m" (UID: "3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:57.148689 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.148651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:57.148853 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.148809 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:23:57.148853 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.148835 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:23:57.148853 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.148847 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ppxpm for pod openshift-network-diagnostics/network-check-target-nnppj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:57.149023 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.148919 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm podName:6abc33af-bfd3-4ff2-9f2d-ba83d562a91e nodeName:}" failed. No retries permitted until 2026-09-10 17:23:59.148901188 +0000 UTC m=+6.168828321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ppxpm" (UniqueName: "kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm") pod "network-check-target-nnppj" (UID: "6abc33af-bfd3-4ff2-9f2d-ba83d562a91e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:57.392824 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.392742 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:18:55 +0000 UTC" deadline="2028-03-22 03:26:47.178087433 +0000 UTC" Sep 10 17:23:57.392824 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.392785 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13402h2m49.785307102s" Sep 10 17:23:57.428406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.428373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:57.428570 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.428525 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:23:57.428958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.428936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:57.429056 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:57.429036 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:23:57.490009 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.489974 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" event={"ID":"daf4ac3b2e491a7a3fc426c1e652891b","Type":"ContainerStarted","Data":"254bc313ee04788f7606f7edb300f1511e73e3fea99e73aadd31897ed8799747"} Sep 10 17:23:57.505519 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:57.505291 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-138.ec2.internal" podStartSLOduration=3.505272168 podStartE2EDuration="3.505272168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:23:56.467212472 +0000 UTC m=+3.487139624" watchObservedRunningTime="2026-09-10 17:23:57.505272168 +0000 UTC m=+4.525199313" Sep 10 17:23:58.426121 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:58.426089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:58.426569 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:58.426218 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:23:59.065149 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:59.064348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:23:59.065149 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:59.064429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:59.065149 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.064574 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:59.065149 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.064651 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:03.064616427 +0000 UTC m=+10.084543572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:23:59.065149 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.065043 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:59.065149 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.065093 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret podName:3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:03.065077946 +0000 UTC m=+10.085005095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret") pod "global-pull-secret-syncer-wbp2m" (UID: "3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:23:59.165078 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:59.165044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:59.165274 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.165206 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:23:59.165274 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.165226 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:23:59.165274 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.165237 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ppxpm for pod openshift-network-diagnostics/network-check-target-nnppj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:59.165420 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.165292 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm podName:6abc33af-bfd3-4ff2-9f2d-ba83d562a91e nodeName:}" failed. No retries permitted until 2026-09-10 17:24:03.16527517 +0000 UTC m=+10.185202320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ppxpm" (UniqueName: "kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm") pod "network-check-target-nnppj" (UID: "6abc33af-bfd3-4ff2-9f2d-ba83d562a91e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:23:59.427869 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:59.427778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:23:59.428288 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.427931 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:23:59.428411 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:23:59.428392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:23:59.428512 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:23:59.428490 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:00.425845 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:00.425802 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:00.426038 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:00.425936 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:01.427490 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:01.427460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:01.427950 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:01.427607 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:01.428004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:01.427955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:01.428039 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:01.428025 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:02.426058 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:02.425977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:02.426199 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:02.426091 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:03.098502 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:03.098462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:03.099000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:03.098556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:03.099000 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.098661 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:24:03.099000 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.098699 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:24:03.099000 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.098730 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret podName:3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:11.098714412 +0000 UTC m=+18.118641560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret") pod "global-pull-secret-syncer-wbp2m" (UID: "3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:24:03.099000 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.098755 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:11.098738072 +0000 UTC m=+18.118665203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:24:03.199157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:03.199117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:03.199335 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.199262 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:24:03.199335 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.199282 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:24:03.199335 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.199295 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ppxpm for pod openshift-network-diagnostics/network-check-target-nnppj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:24:03.199491 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.199348 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm podName:6abc33af-bfd3-4ff2-9f2d-ba83d562a91e nodeName:}" failed. No retries permitted until 2026-09-10 17:24:11.199330635 +0000 UTC m=+18.219257766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ppxpm" (UniqueName: "kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm") pod "network-check-target-nnppj" (UID: "6abc33af-bfd3-4ff2-9f2d-ba83d562a91e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:24:03.426515 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:03.426434 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:03.426699 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.426536 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:03.426929 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:03.426912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:03.427045 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:03.427029 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:04.425940 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:04.425903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:04.426347 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:04.426028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:05.426416 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:05.426372 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:05.426917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:05.426372 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:05.426917 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:05.426525 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:05.426917 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:05.426549 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:06.426381 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:06.426112 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:06.426524 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:06.426501 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:07.426072 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:07.426038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:07.426072 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:07.426069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:07.426311 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:07.426208 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:07.426311 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:07.426283 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:08.425805 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:08.425775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:08.426241 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:08.425892 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:09.425878 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:09.425846 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:09.426298 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:09.425846 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:09.426298 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:09.425994 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:09.426298 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:09.426044 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:10.426455 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:10.426421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:10.427007 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:10.426550 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:11.154700 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:11.154664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:11.154884 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:11.154726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:11.154884 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.154824 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:24:11.154884 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.154836 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:24:11.154884 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.154886 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:27.154868396 +0000 UTC m=+34.174795549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:24:11.155072 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.154900 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret podName:3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:27.154893433 +0000 UTC m=+34.174820562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret") pod "global-pull-secret-syncer-wbp2m" (UID: "3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:24:11.255958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:11.255926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:11.256116 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.256054 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:24:11.256116 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.256075 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:24:11.256116 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.256083 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ppxpm for pod openshift-network-diagnostics/network-check-target-nnppj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:24:11.256251 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.256140 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm podName:6abc33af-bfd3-4ff2-9f2d-ba83d562a91e nodeName:}" failed. No retries permitted until 2026-09-10 17:24:27.25612556 +0000 UTC m=+34.276052709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ppxpm" (UniqueName: "kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm") pod "network-check-target-nnppj" (UID: "6abc33af-bfd3-4ff2-9f2d-ba83d562a91e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:24:11.426019 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:11.425952 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:11.426158 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.426068 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:11.426158 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:11.426113 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:11.426274 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:11.426225 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:12.425993 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:12.425964 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:12.426412 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:12.426073 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:13.426373 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:13.426345 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:13.426857 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:13.426452 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:13.426857 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:13.426541 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:13.426857 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:13.426653 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:14.426529 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.426374 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:14.427019 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:14.426600 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:14.526209 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.526180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" event={"ID":"84396190-5a37-4dca-a48b-cfff4bb5ef9c","Type":"ContainerStarted","Data":"ff8e888ca466e7ddb5e423297c418975f91ce1118850b36d5085e120a004922f"} Sep 10 17:24:14.527607 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.527575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-294nx" event={"ID":"8f35879b-7d56-41ed-b169-88af090de606","Type":"ContainerStarted","Data":"80aaa242a7be490523f8c633a024fa3c024c4c4bb3184626052aba2d0596a814"} Sep 10 17:24:14.529001 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.528974 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bvpp" event={"ID":"c93b03a1-a891-40ae-ac9e-b12918218e6b","Type":"ContainerStarted","Data":"69bf12a53e0f7755ba919f77153eba9aa50166640f6e776160a0acbae56c2923"} Sep 10 17:24:14.530285 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.530266 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jp7bx" event={"ID":"9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105","Type":"ContainerStarted","Data":"8d4f1f8e8a723ce22870b4ed3f3c92bcaed9c1321436c3b0a3685ce2ee031f4d"} Sep 10 17:24:14.531669 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.531630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cmr5h" event={"ID":"fd1d4809-08c3-4961-91c1-ac91158d616d","Type":"ContainerStarted","Data":"fb0c399e2e7485ea4bd98e036938ab6fe2138000fdd0df95de03f419d3dc5ccf"} Sep 10 17:24:14.533120 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.533100 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e1be7dd-da00-42e8-b73e-242d73795a4c" containerID="8a9d525448b499480113b98bfc6a18f9ab4c280c2d45cba1d6c1907104cd1617" exitCode=0 Sep 10 17:24:14.533205 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.533179 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerDied","Data":"8a9d525448b499480113b98bfc6a18f9ab4c280c2d45cba1d6c1907104cd1617"} Sep 10 17:24:14.535666 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.535629 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"d1dc6a71d3b7c041f5ecd9cda5acf51c7004667f6f1960a6958c9151f78de876"} Sep 10 17:24:14.535743 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.535713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"88095b165cd4543e9195399949ebe06593d0c3c0eda67ab1b23b5ea81c43a130"} Sep 10 17:24:14.535805 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.535745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"5635f39aad74cf77fd2f0f71439a54291f85c30122d4204b6f370519671b1bfa"} Sep 10 17:24:14.535805 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.535778 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"9fc36024596e662a7a873ada922f9a56c43af6c2b0db332e41d5c8c41f602cfe"} Sep 10 17:24:14.536985 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.536968 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvnft" event={"ID":"3970f00e-faf3-486e-aa5a-9e00e0cbfea2","Type":"ContainerStarted","Data":"d8b2424a39bc4111cfd07d8e38cf308b607a4cf4c65ff68ca35c0c4ca76c13c8"} Sep 10 17:24:14.550161 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.548976 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-138.ec2.internal" podStartSLOduration=20.548960041 podStartE2EDuration="20.548960041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:23:57.506513441 +0000 UTC m=+4.526440595" watchObservedRunningTime="2026-09-10 17:24:14.548960041 +0000 UTC m=+21.568887193" Sep 10 17:24:14.550161 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.549078 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-294nx" podStartSLOduration=3.665963958 podStartE2EDuration="21.549072925s" totalImagesPullingTime="17.883108967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:14.548061362 +0000 UTC m=+21.567988518" watchObservedRunningTime="2026-09-10 17:24:14.549072925 +0000 UTC m=+21.569000078" Sep 10 17:24:14.563565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.563530 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jp7bx" podStartSLOduration=3.743713597 podStartE2EDuration="21.563513876s" totalImagesPullingTime="17.819800279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:14.563386845 +0000 UTC m=+21.583313997" watchObservedRunningTime="2026-09-10 17:24:14.563513876 +0000 UTC m=+21.583441034" Sep 10 17:24:14.577545 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.577508 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cmr5h" podStartSLOduration=11.046246121 podStartE2EDuration="21.577497006s" totalImagesPullingTime="10.531250885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:14.57728324 +0000 UTC m=+21.597210391" watchObservedRunningTime="2026-09-10 17:24:14.577497006 +0000 UTC m=+21.597424157" Sep 10 17:24:14.594622 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.594590 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9bvpp" podStartSLOduration=3.761093653 podStartE2EDuration="21.594578992s" totalImagesPullingTime="17.833485339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:14.59412859 +0000 UTC m=+21.614055743" watchObservedRunningTime="2026-09-10 17:24:14.594578992 +0000 UTC m=+21.614506145" Sep 10 17:24:14.641210 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:14.641175 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qvnft" podStartSLOduration=3.821616229 podStartE2EDuration="21.641163109s" totalImagesPullingTime="17.81954688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:14.64105026 +0000 UTC m=+21.660977412" watchObservedRunningTime="2026-09-10 17:24:14.641163109 +0000 UTC m=+21.661090260" Sep 10 17:24:15.407048 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.406816 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 17:24:15.426163 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.426140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:15.426300 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:15.426275 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:15.426667 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.426629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:15.427054 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:15.426739 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:15.541123 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.541033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" event={"ID":"84396190-5a37-4dca-a48b-cfff4bb5ef9c","Type":"ContainerStarted","Data":"ea9bfc3d5a6ddee8e7516c7bdf1190e55aa2d57a437c1ec862120733db8c6b36"} Sep 10 17:24:15.542832 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.542804 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klj4b" event={"ID":"381d0284-dcdf-460d-b6f1-48715caa3c5f","Type":"ContainerStarted","Data":"4405b2ff1ab1e47e933b3dd3e870801b942bbaffd4f280bc3d89cb39698040e6"} Sep 10 17:24:15.546423 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.546372 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"82021b3130f5dbae06255c734853704090dee654fad53c8504a63970e2a95222"} Sep 10 17:24:15.546501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.546452 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"0ea5e84652e07800c2f2a3d56d36202b3f6623e37936ada14f53d27faaadb742"} Sep 10 17:24:15.559040 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:15.558996 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-klj4b" podStartSLOduration=4.73211205 podStartE2EDuration="22.558984934s" totalImagesPullingTime="17.826872884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:15.558947156 +0000 UTC m=+22.578874307" watchObservedRunningTime="2026-09-10 17:24:15.558984934 +0000 UTC m=+22.578912086" Sep 10 17:24:16.393807 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:16.393703 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T17:24:15.407023084Z","UUID":"038e9c18-5370-4c29-9f0b-73031951750c","Handler":null,"Name":"","Endpoint":""} Sep 10 17:24:16.396478 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:16.396454 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 17:24:16.396587 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:16.396506 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 17:24:16.425508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:16.425475 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:16.425621 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:16.425589 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:16.550656 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:16.550610 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" event={"ID":"84396190-5a37-4dca-a48b-cfff4bb5ef9c","Type":"ContainerStarted","Data":"1b724ea234fa0430a0f230cdfcb71ee6989091b503946a8f0e74575381be7123"} Sep 10 17:24:16.571146 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:16.571102 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxf84" podStartSLOduration=3.758342864 podStartE2EDuration="23.57108978s" totalImagesPullingTime="19.812746916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:16.570671778 +0000 UTC m=+23.590598931" watchObservedRunningTime="2026-09-10 17:24:16.57108978 +0000 UTC m=+23.591016931" Sep 10 17:24:17.425838 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:17.425809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:17.426005 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:17.425932 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:17.426005 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:17.425810 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:17.426119 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:17.426097 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:17.557760 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:17.557722 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"b666b8882ae21cb86f974941e8a7be7f93144420ce4262f91091f2a3f9ab8cc4"} Sep 10 17:24:18.425903 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:18.425871 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:18.426082 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:18.425995 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:19.165844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.165689 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:24:19.166314 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.166297 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:24:19.426391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.426325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:19.426507 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:19.426428 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:19.426507 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.426466 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:19.426617 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:19.426520 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:19.563012 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.562980 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e1be7dd-da00-42e8-b73e-242d73795a4c" containerID="df3a64d2b2fb8f9a384e6aac27ac3a17cfaad835ed4df97f10504f3f437748e1" exitCode=0 Sep 10 17:24:19.563139 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.563059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerDied","Data":"df3a64d2b2fb8f9a384e6aac27ac3a17cfaad835ed4df97f10504f3f437748e1"} Sep 10 17:24:19.567685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.567652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" event={"ID":"ef9dccf3-b965-4f14-9eb9-94e21a83b8f6","Type":"ContainerStarted","Data":"38a8d57c670dd4020348a586ce5be855aa039f013d06538a34ef21ca8087ee51"} Sep 10 17:24:19.567959 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.567940 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:24:19.568373 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.568353 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cmr5h" Sep 10 17:24:19.621531 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:19.621495 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" podStartSLOduration=8.738561148 podStartE2EDuration="26.621483423s" totalImagesPullingTime="17.882922275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:19.620974797 +0000 UTC m=+26.640901948" watchObservedRunningTime="2026-09-10 17:24:19.621483423 +0000 UTC m=+26.641410574" Sep 10 17:24:20.425697 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.425670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:20.426168 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:20.425762 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:20.570702 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.570670 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:24:20.570878 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.570754 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:24:20.570878 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.570805 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:24:20.585918 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.585895 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:24:20.586056 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.586033 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:24:20.942591 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.942521 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wbp2m"] Sep 10 17:24:20.942718 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.942710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:20.942870 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:20.942844 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:20.945613 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.945587 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nnppj"] Sep 10 17:24:20.945774 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.945723 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:20.945824 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:20.945808 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:20.946448 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.946422 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vx8dz"] Sep 10 17:24:20.946709 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:20.946688 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:20.946836 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:20.946801 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:21.574605 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:21.574573 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e1be7dd-da00-42e8-b73e-242d73795a4c" containerID="a9d41b3279d93ddfbd33fbfed3166fd6a09339e518f87b1fd6fe25f988b09f5b" exitCode=0 Sep 10 17:24:21.575275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:21.574712 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerDied","Data":"a9d41b3279d93ddfbd33fbfed3166fd6a09339e518f87b1fd6fe25f988b09f5b"} Sep 10 17:24:22.425949 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:22.425916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:22.425949 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:22.425947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:22.426166 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:22.426021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:22.426166 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:22.426028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:22.426166 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:22.426092 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:22.426166 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:22.426153 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:23.581565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:23.581410 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e1be7dd-da00-42e8-b73e-242d73795a4c" containerID="18926eabe73d577eb01abff7ed6f071772a8af8896b4a8f563c71b909d949115" exitCode=0 Sep 10 17:24:23.581954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:23.581477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerDied","Data":"18926eabe73d577eb01abff7ed6f071772a8af8896b4a8f563c71b909d949115"} Sep 10 17:24:24.425730 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:24.425633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:24.425926 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:24.425762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:24.425926 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:24.425775 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:24.425926 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:24.425793 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:24.425926 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:24.425889 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:24.426123 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:24.425962 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:26.426198 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.426161 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:26.426798 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.426211 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:26.426798 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.426174 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:26.426798 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:26.426299 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbp2m" podUID="3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0" Sep 10 17:24:26.426798 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:26.426407 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnppj" podUID="6abc33af-bfd3-4ff2-9f2d-ba83d562a91e" Sep 10 17:24:26.426798 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:26.426500 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx8dz" podUID="b2636c52-57f6-452e-af71-f5dfe97c3335" Sep 10 17:24:26.786604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.786573 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-138.ec2.internal" event="NodeReady" Sep 10 17:24:26.786801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.786738 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 17:24:26.840837 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.840810 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wb4sd"] Sep 10 17:24:26.843304 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.843281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:26.846812 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.846776 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 17:24:26.846939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.846853 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vn8bp\"" Sep 10 17:24:26.846999 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.846783 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 17:24:26.850692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.850671 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wsprp"] Sep 10 17:24:26.852696 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.852677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:26.858384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.858365 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 17:24:26.858459 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.858446 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dfch6\"" Sep 10 17:24:26.858510 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.858367 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 17:24:26.858569 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.858368 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 17:24:26.862707 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.862688 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wb4sd"] Sep 10 17:24:26.867493 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.867467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wsprp"] Sep 10 17:24:26.973533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.973509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f964bb89-dc3b-41b5-870d-5b45c48e543b-config-volume\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:26.973681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.973539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682lq\" (UniqueName: \"kubernetes.io/projected/f964bb89-dc3b-41b5-870d-5b45c48e543b-kube-api-access-682lq\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:26.973681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.973557 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:26.973681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.973572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d97d8ac-90b4-4d8e-b7a3-182f30013876-cert\") pod \"ingress-canary-wsprp\" (UID: \"5d97d8ac-90b4-4d8e-b7a3-182f30013876\") " pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:26.973841 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.973698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f964bb89-dc3b-41b5-870d-5b45c48e543b-tmp-dir\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:26.973841 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:26.973736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzrzn\" (UniqueName: \"kubernetes.io/projected/5d97d8ac-90b4-4d8e-b7a3-182f30013876-kube-api-access-vzrzn\") pod \"ingress-canary-wsprp\" (UID: \"5d97d8ac-90b4-4d8e-b7a3-182f30013876\") " pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:27.074904 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.074827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f964bb89-dc3b-41b5-870d-5b45c48e543b-config-volume\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.074904 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.074878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682lq\" (UniqueName: \"kubernetes.io/projected/f964bb89-dc3b-41b5-870d-5b45c48e543b-kube-api-access-682lq\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.075085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.074908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.075085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.074934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d97d8ac-90b4-4d8e-b7a3-182f30013876-cert\") pod \"ingress-canary-wsprp\" (UID: \"5d97d8ac-90b4-4d8e-b7a3-182f30013876\") " pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:27.075085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.074978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f964bb89-dc3b-41b5-870d-5b45c48e543b-tmp-dir\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.075085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.075007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzrzn\" (UniqueName: \"kubernetes.io/projected/5d97d8ac-90b4-4d8e-b7a3-182f30013876-kube-api-access-vzrzn\") pod \"ingress-canary-wsprp\" (UID: \"5d97d8ac-90b4-4d8e-b7a3-182f30013876\") " pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:27.075085 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.075071 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:24:27.075328 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.075130 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:24:27.575114299 +0000 UTC m=+34.595041429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:24:27.075488 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.075466 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f964bb89-dc3b-41b5-870d-5b45c48e543b-config-volume\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.075558 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.075472 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f964bb89-dc3b-41b5-870d-5b45c48e543b-tmp-dir\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.080406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.080381 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d97d8ac-90b4-4d8e-b7a3-182f30013876-cert\") pod \"ingress-canary-wsprp\" (UID: \"5d97d8ac-90b4-4d8e-b7a3-182f30013876\") " pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:27.083838 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.083810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-682lq\" (UniqueName: \"kubernetes.io/projected/f964bb89-dc3b-41b5-870d-5b45c48e543b-kube-api-access-682lq\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.084936 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.084911 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzrzn\" (UniqueName: \"kubernetes.io/projected/5d97d8ac-90b4-4d8e-b7a3-182f30013876-kube-api-access-vzrzn\") pod \"ingress-canary-wsprp\" (UID: \"5d97d8ac-90b4-4d8e-b7a3-182f30013876\") " pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:27.162881 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.162859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wsprp" Sep 10 17:24:27.175252 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.175233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:27.175356 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.175296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:27.175404 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.175377 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:24:27.175443 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.175404 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:24:27.175443 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.175432 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret podName:3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:59.175418679 +0000 UTC m=+66.195345809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret") pod "global-pull-secret-syncer-wbp2m" (UID: "3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:24:27.175541 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.175462 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:24:59.17544613 +0000 UTC m=+66.195373274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:24:27.275835 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.275809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:27.275979 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.275960 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:24:27.276028 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.275987 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:24:27.276028 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.275998 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ppxpm for pod openshift-network-diagnostics/network-check-target-nnppj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:24:27.276113 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.276061 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm podName:6abc33af-bfd3-4ff2-9f2d-ba83d562a91e nodeName:}" failed. No retries permitted until 2026-09-10 17:24:59.276046069 +0000 UTC m=+66.295973217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ppxpm" (UniqueName: "kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm") pod "network-check-target-nnppj" (UID: "6abc33af-bfd3-4ff2-9f2d-ba83d562a91e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:24:27.578527 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.578357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:27.578527 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.578505 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:24:27.578956 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:27.578570 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:24:28.57855418 +0000 UTC m=+35.598481310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:24:27.595465 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.595433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerStarted","Data":"114cefb0b59fd1d43c38cbe862efe18d35dc0b59084fa48a2cec62ff8217f829"} Sep 10 17:24:27.688234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:27.688184 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wsprp"] Sep 10 17:24:27.691170 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:24:27.691147 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d97d8ac_90b4_4d8e_b7a3_182f30013876.slice/crio-b3605103f14dfaec25f4eb23ef7c1256a08935778a20a454f5eee3772ee9528f WatchSource:0}: Error finding container b3605103f14dfaec25f4eb23ef7c1256a08935778a20a454f5eee3772ee9528f: Status 404 returned error can't find the container with id b3605103f14dfaec25f4eb23ef7c1256a08935778a20a454f5eee3772ee9528f Sep 10 17:24:28.425604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.425539 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:28.425784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.425539 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:28.425784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.425539 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:28.427932 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.427909 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:24:28.428655 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.428616 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v58r5\"" Sep 10 17:24:28.428775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.428712 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:24:28.428775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.428745 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:24:28.429125 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.428712 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qjn9k\"" Sep 10 17:24:28.429125 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.428717 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:24:28.583955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.583931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:28.584277 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:28.584082 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:24:28.584277 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:28.584163 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:24:30.584142673 +0000 UTC m=+37.604069823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:24:28.601894 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.601866 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e1be7dd-da00-42e8-b73e-242d73795a4c" containerID="114cefb0b59fd1d43c38cbe862efe18d35dc0b59084fa48a2cec62ff8217f829" exitCode=0 Sep 10 17:24:28.602012 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.601955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerDied","Data":"114cefb0b59fd1d43c38cbe862efe18d35dc0b59084fa48a2cec62ff8217f829"} Sep 10 17:24:28.603551 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:28.603522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wsprp" event={"ID":"5d97d8ac-90b4-4d8e-b7a3-182f30013876","Type":"ContainerStarted","Data":"b3605103f14dfaec25f4eb23ef7c1256a08935778a20a454f5eee3772ee9528f"} Sep 10 17:24:29.608599 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:29.608561 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e1be7dd-da00-42e8-b73e-242d73795a4c" containerID="1b6a86369aee6a344b3ab83bc86c4ef1a13204495e6e795fccdf94bf2e28bc4e" exitCode=0 Sep 10 17:24:29.609055 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:29.608625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerDied","Data":"1b6a86369aee6a344b3ab83bc86c4ef1a13204495e6e795fccdf94bf2e28bc4e"} Sep 10 17:24:30.206399 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.206364 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:30.384715 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.384687 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:30.483306 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.483241 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:30.545576 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.545550 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:30.598356 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.598332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:30.598495 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:30.598479 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:24:30.598541 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:30.598536 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:24:34.598523028 +0000 UTC m=+41.618450162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:24:30.602569 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.602542 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:30.614328 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.614307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" event={"ID":"5e1be7dd-da00-42e8-b73e-242d73795a4c","Type":"ContainerStarted","Data":"9e9692ccf1e285d577420a8e9101802c3e915c43302113573735786fbfb6c5d8"} Sep 10 17:24:30.615790 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.615767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wsprp" event={"ID":"5d97d8ac-90b4-4d8e-b7a3-182f30013876","Type":"ContainerStarted","Data":"247aad1891ecbd797992588323e6eb350be02a6ef03b15e1a780e98fdba7bb01"} Sep 10 17:24:30.636615 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:30.636571 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t4c8h" podStartSLOduration=9.234930997 podStartE2EDuration="37.636559288s" totalImagesPullingTime="28.401628291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:30.635480301 +0000 UTC m=+37.655407453" watchObservedRunningTime="2026-09-10 17:24:30.636559288 +0000 UTC m=+37.656486460" Sep 10 17:24:31.145418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:31.145240 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:31.244853 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:31.244828 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:31.306051 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:31.306027 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:31.565854 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:31.565786 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:31.622160 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:31.622127 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:32.226210 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:32.226182 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:32.291003 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:32.290964 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:34.624603 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:34.624568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:34.625118 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:34.624762 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:24:34.625118 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:34.624862 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:24:42.624839759 +0000 UTC m=+49.644766933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:24:36.431313 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:36.431279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:36.501852 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:36.501823 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:42.676458 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:42.676417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:42.676953 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:42.676549 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:24:42.676953 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:42.676616 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:24:58.676601706 +0000 UTC m=+65.696528885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:24:47.293600 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:47.293562 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:48.358206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:48.358160 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:52.173011 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:52.172976 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:52.239479 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:52.239441 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:52.589122 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:52.589096 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvmmd" Sep 10 17:24:52.618731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:52.618677 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wsprp" podStartSLOduration=24.639235799 podStartE2EDuration="26.618661043s" totalImagesPullingTime="1.979425244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:30.652737813 +0000 UTC m=+37.672664965" watchObservedRunningTime="2026-09-10 17:24:52.618661043 +0000 UTC m=+59.638588186" Sep 10 17:24:52.718919 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:52.718882 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:52.782275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:52.782233 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:24:58.684094 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:58.684043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:24:58.684557 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:58.684203 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:24:58.684557 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:58.684293 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:25:30.68427318 +0000 UTC m=+97.704200309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:24:59.188163 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.188124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:59.188330 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.188198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:24:59.190442 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.190416 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:24:59.190660 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.190623 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:24:59.199015 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:59.198997 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:24:59.199122 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:24:59.199078 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs podName:b2636c52-57f6-452e-af71-f5dfe97c3335 nodeName:}" failed. No retries permitted until 2026-09-10 17:26:03.199054742 +0000 UTC m=+130.218981891 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs") pod "network-metrics-daemon-vx8dz" (UID: "b2636c52-57f6-452e-af71-f5dfe97c3335") : secret "metrics-daemon-secret" not found Sep 10 17:24:59.202560 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.202536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0-original-pull-secret\") pod \"global-pull-secret-syncer-wbp2m\" (UID: \"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0\") " pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:59.288698 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.288675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:59.290793 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.290778 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:24:59.301391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.301373 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:24:59.312303 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.312279 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppxpm\" (UniqueName: \"kubernetes.io/projected/6abc33af-bfd3-4ff2-9f2d-ba83d562a91e-kube-api-access-ppxpm\") pod \"network-check-target-nnppj\" (UID: \"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e\") " pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:59.346346 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.346324 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v58r5\"" Sep 10 17:24:59.350281 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.350268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbp2m" Sep 10 17:24:59.354405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.354389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:24:59.652653 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.652589 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wbp2m"] Sep 10 17:24:59.656109 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:24:59.656074 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0ca9b3_ec62_46eb_8b4d_90d67ff8afe0.slice/crio-bb836018d3bc26edd3ef6fde3e7b1c575b0c0e937e4c049eac56de8388a54944 WatchSource:0}: Error finding container bb836018d3bc26edd3ef6fde3e7b1c575b0c0e937e4c049eac56de8388a54944: Status 404 returned error can't find the container with id bb836018d3bc26edd3ef6fde3e7b1c575b0c0e937e4c049eac56de8388a54944 Sep 10 17:24:59.672447 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.672427 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nnppj"] Sep 10 17:24:59.674942 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:24:59.674920 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abc33af_bfd3_4ff2_9f2d_ba83d562a91e.slice/crio-5019e4425d922ca9104aa7a2886ecd925b5a0915f89d31a6b591cc8bd4a889c3 WatchSource:0}: Error finding container 5019e4425d922ca9104aa7a2886ecd925b5a0915f89d31a6b591cc8bd4a889c3: Status 404 returned error can't find the container with id 5019e4425d922ca9104aa7a2886ecd925b5a0915f89d31a6b591cc8bd4a889c3 Sep 10 17:24:59.687180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.687152 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wbp2m" event={"ID":"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0","Type":"ContainerStarted","Data":"bb836018d3bc26edd3ef6fde3e7b1c575b0c0e937e4c049eac56de8388a54944"} Sep 10 17:24:59.688228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:24:59.688206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nnppj" event={"ID":"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e","Type":"ContainerStarted","Data":"5019e4425d922ca9104aa7a2886ecd925b5a0915f89d31a6b591cc8bd4a889c3"} Sep 10 17:25:02.821791 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:02.821744 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:02.926627 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:02.926591 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:04.703747 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:04.703699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wbp2m" event={"ID":"3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0","Type":"ContainerStarted","Data":"7cbffd1ca43f4270a81ee12f263cc18dd38c3b64b60ce9e5463a2c8a3f18ad1a"} Sep 10 17:25:04.705506 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:04.705483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nnppj" event={"ID":"6abc33af-bfd3-4ff2-9f2d-ba83d562a91e","Type":"ContainerStarted","Data":"137ad7fee46df73832edf53c15b0781a925fdb536403dd351ab5a126d02ec207"} Sep 10 17:25:04.705650 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:04.705623 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:25:04.732535 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:04.732483 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nnppj" podStartSLOduration=67.382386671 podStartE2EDuration="1m11.73246901s" totalImagesPullingTime="4.350082339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:04.731734212 +0000 UTC m=+71.751661361" watchObservedRunningTime="2026-09-10 17:25:04.73246901 +0000 UTC m=+71.752396161" Sep 10 17:25:04.732877 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:04.732853 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wbp2m" podStartSLOduration=67.360689404 podStartE2EDuration="1m11.732848776s" totalImagesPullingTime="4.372159372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:04.717867647 +0000 UTC m=+71.737794800" watchObservedRunningTime="2026-09-10 17:25:04.732848776 +0000 UTC m=+71.752775928" Sep 10 17:25:27.589053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.588916 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk"] Sep 10 17:25:27.591777 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.591746 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9d87c44-k7klw"] Sep 10 17:25:27.591924 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.591871 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.593491 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.593469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.594160 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.594134 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 17:25:27.594742 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.594685 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 17:25:27.594985 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.594958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 17:25:27.594985 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.594976 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tjsdd\"" Sep 10 17:25:27.595137 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.595117 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 17:25:27.595597 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.595574 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 17:25:27.595597 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.595607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 17:25:27.595988 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.595954 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 17:25:27.596161 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.596143 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 17:25:27.596279 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.596178 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gbkrd\"" Sep 10 17:25:27.596279 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.596240 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 17:25:27.596442 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.596320 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 17:25:27.603213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.603192 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk"] Sep 10 17:25:27.608393 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.608370 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9d87c44-k7klw"] Sep 10 17:25:27.669710 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-default-certificate\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.669820 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.669820 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.669820 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.669973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-stats-auth\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.669973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed305f05-d529-4541-8b6a-99335447658e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.669973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qntss\" (UniqueName: \"kubernetes.io/projected/ed305f05-d529-4541-8b6a-99335447658e-kube-api-access-qntss\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.669973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.669914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wwj8\" (UniqueName: \"kubernetes.io/projected/a9758fc6-dc5e-4d88-860b-31572756f191-kube-api-access-2wwj8\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.710594 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.710562 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-xpb6t"] Sep 10 17:25:27.713122 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.713108 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.718037 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.718018 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 17:25:27.718341 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.718325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 17:25:27.719183 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.719162 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4xv2h\"" Sep 10 17:25:27.719411 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.719378 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 17:25:27.719411 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.719396 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 17:25:27.726916 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.726898 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 17:25:27.736766 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.736734 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-xpb6t"] Sep 10 17:25:27.762323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.762300 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:27.770157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-default-certificate\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.770247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.770247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.770247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.770404 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:27.770303 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:25:27.770404 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:27.770315 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:28.270297761 +0000 UTC m=+95.290224891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : configmap references non-existent config key: service-ca.crt Sep 10 17:25:27.770404 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abef3868-6891-4c5e-8e7f-15fe407e3688-snapshots\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.770404 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:27.770360 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:28.270346994 +0000 UTC m=+95.290274127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : secret "router-metrics-certs-default" not found Sep 10 17:25:27.770404 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:27.770303 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:27.770404 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:27.770404 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls podName:ed305f05-d529-4541-8b6a-99335447658e nodeName:}" failed. No retries permitted until 2026-09-10 17:25:28.27039112 +0000 UTC m=+95.290318274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-p9qfk" (UID: "ed305f05-d529-4541-8b6a-99335447658e") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-stats-auth\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed305f05-d529-4541-8b6a-99335447658e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770486 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qntss\" (UniqueName: \"kubernetes.io/projected/ed305f05-d529-4541-8b6a-99335447658e-kube-api-access-qntss\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abef3868-6891-4c5e-8e7f-15fe407e3688-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wwj8\" (UniqueName: \"kubernetes.io/projected/a9758fc6-dc5e-4d88-860b-31572756f191-kube-api-access-2wwj8\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abef3868-6891-4c5e-8e7f-15fe407e3688-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abef3868-6891-4c5e-8e7f-15fe407e3688-tmp\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abef3868-6891-4c5e-8e7f-15fe407e3688-serving-cert\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.770737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.770681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csvbk\" (UniqueName: \"kubernetes.io/projected/abef3868-6891-4c5e-8e7f-15fe407e3688-kube-api-access-csvbk\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.771149 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.771132 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed305f05-d529-4541-8b6a-99335447658e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.772849 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.772830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-default-certificate\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.772943 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.772852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-stats-auth\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.780625 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.780600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qntss\" (UniqueName: \"kubernetes.io/projected/ed305f05-d529-4541-8b6a-99335447658e-kube-api-access-qntss\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:27.780741 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.780713 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wwj8\" (UniqueName: \"kubernetes.io/projected/a9758fc6-dc5e-4d88-860b-31572756f191-kube-api-access-2wwj8\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:27.801746 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.801724 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf"] Sep 10 17:25:27.803585 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.803571 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v"] Sep 10 17:25:27.803721 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.803706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:27.805096 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.805081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.806624 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.806608 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 17:25:27.806745 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.806730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5hdpx\"" Sep 10 17:25:27.807054 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.807039 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 17:25:27.807149 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.807130 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:25:27.807369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.807355 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 17:25:27.807451 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.807433 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-z6t94\"" Sep 10 17:25:27.807892 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.807828 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 17:25:27.808033 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.808018 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 17:25:27.808594 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.808580 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:25:27.816605 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.816582 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf"] Sep 10 17:25:27.819267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.819248 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v"] Sep 10 17:25:27.836590 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.836562 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4cd\" (UniqueName: \"kubernetes.io/projected/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-kube-api-access-lt4cd\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abef3868-6891-4c5e-8e7f-15fe407e3688-snapshots\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abef3868-6891-4c5e-8e7f-15fe407e3688-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abef3868-6891-4c5e-8e7f-15fe407e3688-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872629 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abef3868-6891-4c5e-8e7f-15fe407e3688-tmp\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abef3868-6891-4c5e-8e7f-15fe407e3688-serving-cert\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csvbk\" (UniqueName: \"kubernetes.io/projected/abef3868-6891-4c5e-8e7f-15fe407e3688-kube-api-access-csvbk\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxjjl\" (UniqueName: \"kubernetes.io/projected/c78ee545-f850-4982-9d1b-cad6ef2a2afe-kube-api-access-wxjjl\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.872775 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.873463 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abef3868-6891-4c5e-8e7f-15fe407e3688-snapshots\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.874370 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abef3868-6891-4c5e-8e7f-15fe407e3688-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.874867 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abef3868-6891-4c5e-8e7f-15fe407e3688-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.875323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.875114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abef3868-6891-4c5e-8e7f-15fe407e3688-tmp\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.877772 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.877752 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abef3868-6891-4c5e-8e7f-15fe407e3688-serving-cert\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.883469 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.883451 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csvbk\" (UniqueName: \"kubernetes.io/projected/abef3868-6891-4c5e-8e7f-15fe407e3688-kube-api-access-csvbk\") pod \"insights-operator-76bcd6ccf5-xpb6t\" (UID: \"abef3868-6891-4c5e-8e7f-15fe407e3688\") " pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:27.973396 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.973372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.973465 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.973412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxjjl\" (UniqueName: \"kubernetes.io/projected/c78ee545-f850-4982-9d1b-cad6ef2a2afe-kube-api-access-wxjjl\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:27.973465 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.973436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.973578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.973557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4cd\" (UniqueName: \"kubernetes.io/projected/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-kube-api-access-lt4cd\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.973707 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.973688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:27.973805 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:27.973789 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 17:25:27.973868 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:27.973857 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls podName:c78ee545-f850-4982-9d1b-cad6ef2a2afe nodeName:}" failed. No retries permitted until 2026-09-10 17:25:28.473841648 +0000 UTC m=+95.493768778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-7ntzf" (UID: "c78ee545-f850-4982-9d1b-cad6ef2a2afe") : secret "samples-operator-tls" not found Sep 10 17:25:27.973984 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.973966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.975675 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.975628 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:27.981550 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.981521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxjjl\" (UniqueName: \"kubernetes.io/projected/c78ee545-f850-4982-9d1b-cad6ef2a2afe-kube-api-access-wxjjl\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:27.981978 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:27.981960 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4cd\" (UniqueName: \"kubernetes.io/projected/fdfc6c25-6050-4909-bc9f-f493c7f81ff1-kube-api-access-lt4cd\") pod \"kube-storage-version-migrator-operator-8d7dd4675-gnh6v\" (UID: \"fdfc6c25-6050-4909-bc9f-f493c7f81ff1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:28.022351 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.022330 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" Sep 10 17:25:28.119116 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.119089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" Sep 10 17:25:28.275949 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.275925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:28.276079 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.275960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:28.276079 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.276006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:28.276177 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:28.276094 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:25:28.276177 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:28.276139 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:28.276252 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:28.276194 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls podName:ed305f05-d529-4541-8b6a-99335447658e nodeName:}" failed. No retries permitted until 2026-09-10 17:25:29.276177409 +0000 UTC m=+96.296104568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-p9qfk" (UID: "ed305f05-d529-4541-8b6a-99335447658e") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:28.276252 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:28.276210 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:29.276202103 +0000 UTC m=+96.296129232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : configmap references non-existent config key: service-ca.crt Sep 10 17:25:28.276252 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:28.276234 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:29.276225627 +0000 UTC m=+96.296152760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : secret "router-metrics-certs-default" not found Sep 10 17:25:28.290498 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.290477 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-xpb6t"] Sep 10 17:25:28.293263 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:25:28.293242 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabef3868_6891_4c5e_8e7f_15fe407e3688.slice/crio-9800f07297af196bb10c7de57da3c83090f69f1de67ea5cf69855457b0d3e7b8 WatchSource:0}: Error finding container 9800f07297af196bb10c7de57da3c83090f69f1de67ea5cf69855457b0d3e7b8: Status 404 returned error can't find the container with id 9800f07297af196bb10c7de57da3c83090f69f1de67ea5cf69855457b0d3e7b8 Sep 10 17:25:28.382757 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.382709 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v"] Sep 10 17:25:28.385875 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:25:28.385856 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfc6c25_6050_4909_bc9f_f493c7f81ff1.slice/crio-4a1a3cf4ef7f596a742a495693c720f90fb01bf10c95646d903bb01cfebb8bec WatchSource:0}: Error finding container 4a1a3cf4ef7f596a742a495693c720f90fb01bf10c95646d903bb01cfebb8bec: Status 404 returned error can't find the container with id 4a1a3cf4ef7f596a742a495693c720f90fb01bf10c95646d903bb01cfebb8bec Sep 10 17:25:28.478185 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.478156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:28.478281 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:28.478252 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 17:25:28.478319 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:28.478302 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls podName:c78ee545-f850-4982-9d1b-cad6ef2a2afe nodeName:}" failed. No retries permitted until 2026-09-10 17:25:29.478285184 +0000 UTC m=+96.498212317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-7ntzf" (UID: "c78ee545-f850-4982-9d1b-cad6ef2a2afe") : secret "samples-operator-tls" not found Sep 10 17:25:28.764084 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.764043 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" event={"ID":"abef3868-6891-4c5e-8e7f-15fe407e3688","Type":"ContainerStarted","Data":"9800f07297af196bb10c7de57da3c83090f69f1de67ea5cf69855457b0d3e7b8"} Sep 10 17:25:28.765376 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:28.765351 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" event={"ID":"fdfc6c25-6050-4909-bc9f-f493c7f81ff1","Type":"ContainerStarted","Data":"4a1a3cf4ef7f596a742a495693c720f90fb01bf10c95646d903bb01cfebb8bec"} Sep 10 17:25:29.282692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:29.282652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:29.282860 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:29.282711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:29.282860 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:29.282792 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:29.282860 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:29.282821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:29.283013 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:29.282864 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls podName:ed305f05-d529-4541-8b6a-99335447658e nodeName:}" failed. No retries permitted until 2026-09-10 17:25:31.282844503 +0000 UTC m=+98.302771648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-p9qfk" (UID: "ed305f05-d529-4541-8b6a-99335447658e") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:29.283013 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:29.282915 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:25:29.283013 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:29.282933 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:31.282916999 +0000 UTC m=+98.302844152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : configmap references non-existent config key: service-ca.crt Sep 10 17:25:29.283013 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:29.282954 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:31.282944754 +0000 UTC m=+98.302871908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : secret "router-metrics-certs-default" not found Sep 10 17:25:29.484525 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:29.484490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:29.484693 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:29.484628 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 17:25:29.484750 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:29.484696 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls podName:c78ee545-f850-4982-9d1b-cad6ef2a2afe nodeName:}" failed. No retries permitted until 2026-09-10 17:25:31.484683348 +0000 UTC m=+98.504610481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-7ntzf" (UID: "c78ee545-f850-4982-9d1b-cad6ef2a2afe") : secret "samples-operator-tls" not found Sep 10 17:25:30.293609 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:30.293572 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:30.353039 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:30.353008 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:30.695126 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:30.695046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:25:30.695284 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:30.695231 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:25:30.695342 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:30.695296 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls podName:f964bb89-dc3b-41b5-870d-5b45c48e543b nodeName:}" failed. No retries permitted until 2026-09-10 17:26:34.695280125 +0000 UTC m=+161.715207259 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls") pod "dns-default-wb4sd" (UID: "f964bb89-dc3b-41b5-870d-5b45c48e543b") : secret "dns-default-metrics-tls" not found Sep 10 17:25:30.773382 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:30.773315 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" event={"ID":"abef3868-6891-4c5e-8e7f-15fe407e3688","Type":"ContainerStarted","Data":"dec6dcfe9d12ae4aea84d418c1e70818c378a5c07f89717b72a0bdfdf445951b"} Sep 10 17:25:30.790692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:30.790613 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" podStartSLOduration=1.724895436 podStartE2EDuration="3.790593251s" totalImagesPullingTime="2.065697815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:30.789568234 +0000 UTC m=+97.809495387" watchObservedRunningTime="2026-09-10 17:25:30.790593251 +0000 UTC m=+97.810520404" Sep 10 17:25:31.300019 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.299937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:31.300019 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.299987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:31.300434 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.300022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:31.300434 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:31.300110 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:25:31.300434 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:31.300175 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:31.300434 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:31.300183 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:35.30016535 +0000 UTC m=+102.320092484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : configmap references non-existent config key: service-ca.crt Sep 10 17:25:31.300434 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:31.300253 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:35.300234364 +0000 UTC m=+102.320161498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : secret "router-metrics-certs-default" not found Sep 10 17:25:31.300434 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:31.300267 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls podName:ed305f05-d529-4541-8b6a-99335447658e nodeName:}" failed. No retries permitted until 2026-09-10 17:25:35.300259983 +0000 UTC m=+102.320187112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-p9qfk" (UID: "ed305f05-d529-4541-8b6a-99335447658e") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:31.500882 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.500850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:31.501019 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:31.500999 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 17:25:31.501074 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:31.501062 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls podName:c78ee545-f850-4982-9d1b-cad6ef2a2afe nodeName:}" failed. No retries permitted until 2026-09-10 17:25:35.501047019 +0000 UTC m=+102.520974150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-7ntzf" (UID: "c78ee545-f850-4982-9d1b-cad6ef2a2afe") : secret "samples-operator-tls" not found Sep 10 17:25:31.777438 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.777400 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" event={"ID":"fdfc6c25-6050-4909-bc9f-f493c7f81ff1","Type":"ContainerStarted","Data":"ac318cd145a99e9db90e6521d254ecc4b6ecac2bb597724136cf7cd2bcb84d6a"} Sep 10 17:25:31.793873 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.793827 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" podStartSLOduration=2.190417477 podStartE2EDuration="4.793812158s" totalImagesPullingTime="2.603394681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:31.793240683 +0000 UTC m=+98.813167836" watchObservedRunningTime="2026-09-10 17:25:31.793812158 +0000 UTC m=+98.813739307" Sep 10 17:25:31.908874 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.908843 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j9mv4"] Sep 10 17:25:31.912156 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.912134 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:31.914372 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.914347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 17:25:31.914484 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.914469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-82xn6\"" Sep 10 17:25:31.914539 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.914478 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 17:25:31.929721 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.929597 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9mv4"] Sep 10 17:25:31.931237 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:31.931209 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:32.003941 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.003907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-crio-socket\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.004086 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.003964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v2wt\" (UniqueName: \"kubernetes.io/projected/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-api-access-2v2wt\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.004086 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.004057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-data-volume\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.004155 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.004092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.004155 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.004142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.046002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.045938 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:32.104575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.104546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-crio-socket\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.104691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.104579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v2wt\" (UniqueName: \"kubernetes.io/projected/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-api-access-2v2wt\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.104691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.104628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-data-volume\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.104691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.104677 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-crio-socket\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.104795 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.104752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.104883 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.104835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.104930 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.104888 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:25:32.104930 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.104914 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-data-volume\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.105021 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.104937 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:32.604922575 +0000 UTC m=+99.624849727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : secret "insights-runtime-extractor-tls" not found Sep 10 17:25:32.105021 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.104948 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:25:32.105110 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.105034 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:32.605015927 +0000 UTC m=+99.624943074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : configmap "kube-rbac-proxy" not found Sep 10 17:25:32.121162 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.121134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v2wt\" (UniqueName: \"kubernetes.io/projected/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-api-access-2v2wt\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.147629 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.147610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:32.245004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.244979 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:32.337692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.337604 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:32.609267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.609200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.609267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:32.609263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:32.609396 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.609331 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:25:32.609396 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.609358 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:25:32.609452 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.609401 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:33.609385843 +0000 UTC m=+100.629312976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : secret "insights-runtime-extractor-tls" not found Sep 10 17:25:32.609452 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:32.609417 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:33.609410187 +0000 UTC m=+100.629337317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : configmap "kube-rbac-proxy" not found Sep 10 17:25:33.116576 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:33.116545 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:33.216920 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:33.216889 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:33.617444 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:33.617419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:33.617799 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:33.617470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:33.617799 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:33.617542 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:25:33.617799 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:33.617550 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:25:33.617799 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:33.617594 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:35.617582278 +0000 UTC m=+102.637509408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : configmap "kube-rbac-proxy" not found Sep 10 17:25:33.617799 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:33.617606 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:35.617599906 +0000 UTC m=+102.637527035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : secret "insights-runtime-extractor-tls" not found Sep 10 17:25:33.811083 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:33.811042 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:33.851529 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:33.851508 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bvpp_c93b03a1-a891-40ae-ac9e-b12918218e6b/dns-node-resolver/0.log" Sep 10 17:25:33.870253 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:33.870194 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:34.311240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:34.311206 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:34.377817 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:34.377792 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:34.850694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:34.850665 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jp7bx_9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105/node-ca/0.log" Sep 10 17:25:35.330165 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.330135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:35.330345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.330170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:35.330345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.330233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:35.330345 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.330289 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:35.330345 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.330315 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:25:35.330469 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.330359 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:43.330341287 +0000 UTC m=+110.350268430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : secret "router-metrics-certs-default" not found Sep 10 17:25:35.330469 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.330381 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls podName:ed305f05-d529-4541-8b6a-99335447658e nodeName:}" failed. No retries permitted until 2026-09-10 17:25:43.33037221 +0000 UTC m=+110.350299339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-p9qfk" (UID: "ed305f05-d529-4541-8b6a-99335447658e") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:35.330469 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.330399 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:43.330390323 +0000 UTC m=+110.350317453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : configmap references non-existent config key: service-ca.crt Sep 10 17:25:35.453896 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.453865 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:35.532206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.532176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:35.532453 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.532431 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 17:25:35.532554 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.532493 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls podName:c78ee545-f850-4982-9d1b-cad6ef2a2afe nodeName:}" failed. No retries permitted until 2026-09-10 17:25:43.532478158 +0000 UTC m=+110.552405332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-7ntzf" (UID: "c78ee545-f850-4982-9d1b-cad6ef2a2afe") : secret "samples-operator-tls" not found Sep 10 17:25:35.632917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.632850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:35.632917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.632918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:35.633027 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.632976 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:25:35.633027 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.633025 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:39.633012542 +0000 UTC m=+106.652939671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : secret "insights-runtime-extractor-tls" not found Sep 10 17:25:35.633117 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.633040 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:25:35.633117 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:35.633087 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:39.633074592 +0000 UTC m=+106.653001722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : configmap "kube-rbac-proxy" not found Sep 10 17:25:35.710874 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.710846 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nnppj" Sep 10 17:25:35.850976 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:35.850955 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wsprp_5d97d8ac-90b4-4d8e-b7a3-182f30013876/serve-healthcheck-canary/0.log" Sep 10 17:25:36.436254 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:36.436218 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:37.413018 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:37.412956 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:37.577424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:37.577390 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:37.676792 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:37.676727 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:37.746951 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:37.746928 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:37.963448 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:37.963419 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:38.089355 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:38.089328 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:38.890600 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:38.890566 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:39.290477 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:39.290453 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:39.666085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:39.666028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:39.666211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:39.666090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:39.666211 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:39.666170 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:25:39.666211 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:39.666176 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:25:39.666331 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:39.666234 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:47.666215915 +0000 UTC m=+114.686143062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : secret "insights-runtime-extractor-tls" not found Sep 10 17:25:39.666331 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:39.666247 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm podName:39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:47.666241355 +0000 UTC m=+114.686168485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9mv4" (UID: "39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9") : configmap "kube-rbac-proxy" not found Sep 10 17:25:39.693356 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:39.693305 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:39.896623 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:39.896595 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:40.223571 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:40.223546 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:40.324902 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:40.324869 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:40.892418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:40.892389 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:41.086566 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:41.086517 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:41.287857 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:41.287835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:41.387856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:41.387831 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:41.693187 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:41.693127 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:41.891441 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:41.891386 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:42.290591 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:42.290554 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:43.088275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.088237 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:43.287195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.287161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:43.392411 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.392342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:43.392411 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.392379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:43.392828 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.392442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:43.392828 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:43.392495 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:43.392828 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:43.392566 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls podName:ed305f05-d529-4541-8b6a-99335447658e nodeName:}" failed. No retries permitted until 2026-09-10 17:25:59.392547903 +0000 UTC m=+126.412475045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-p9qfk" (UID: "ed305f05-d529-4541-8b6a-99335447658e") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:25:43.392828 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:25:43.392584 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle podName:a9758fc6-dc5e-4d88-860b-31572756f191 nodeName:}" failed. No retries permitted until 2026-09-10 17:25:59.392575462 +0000 UTC m=+126.412502599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle") pod "router-default-9d87c44-k7klw" (UID: "a9758fc6-dc5e-4d88-860b-31572756f191") : configmap references non-existent config key: service-ca.crt Sep 10 17:25:43.394901 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.394882 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9758fc6-dc5e-4d88-860b-31572756f191-metrics-certs\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:43.484206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.484169 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:43.593449 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.593413 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:43.595862 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.595841 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c78ee545-f850-4982-9d1b-cad6ef2a2afe-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-7ntzf\" (UID: \"c78ee545-f850-4982-9d1b-cad6ef2a2afe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:43.683831 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.683771 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:43.713256 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.713237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" Sep 10 17:25:43.905304 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.905272 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:43.986113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:43.986088 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf"] Sep 10 17:25:44.685075 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:44.685039 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:44.814903 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:44.814879 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" event={"ID":"c78ee545-f850-4982-9d1b-cad6ef2a2afe","Type":"ContainerStarted","Data":"bc3e9fcb3353687447160a4af3e3029d98958d36814e16810b12903b5f49f8d7"} Sep 10 17:25:44.893721 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:44.893662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:45.133552 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:45.133520 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:45.291496 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:45.291467 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:45.483861 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:45.483825 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:45.886263 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:45.886178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:46.485558 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:46.485520 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:46.827429 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:46.827355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" event={"ID":"c78ee545-f850-4982-9d1b-cad6ef2a2afe","Type":"ContainerStarted","Data":"6278797da2b9edb629c7909c9e8bce9a35c94d32893142307d8e4e5093dbb899"} Sep 10 17:25:46.827556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:46.827455 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" event={"ID":"c78ee545-f850-4982-9d1b-cad6ef2a2afe","Type":"ContainerStarted","Data":"e8d6d7213326a06de991b5d14ec416ad922ccd27e4b9458480cbf96cef318dbb"} Sep 10 17:25:46.843445 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:46.843394 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-7ntzf" podStartSLOduration=17.820408165 podStartE2EDuration="19.843379242s" totalImagesPullingTime="2.022971077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:46.842248371 +0000 UTC m=+113.862175543" watchObservedRunningTime="2026-09-10 17:25:46.843379242 +0000 UTC m=+113.863306431" Sep 10 17:25:46.895139 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:46.895110 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:47.280437 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.280400 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:47.684617 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.684536 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:47.720892 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.720860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:47.721000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.720923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:47.721480 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.721447 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:47.723495 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.723474 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9mv4\" (UID: \"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9\") " pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:47.820798 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.820769 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9mv4" Sep 10 17:25:47.839456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.839426 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:47.940623 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:47.940544 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:48.094742 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:48.094698 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:48.099966 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:48.099941 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9mv4"] Sep 10 17:25:48.103395 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:25:48.103368 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a78ca6_fe3c_4e17_88aa_9ff3cb1319a9.slice/crio-58aceccdb43d9a30c011821bb226826b74d3417093cd639ccae20ed9147bfd03 WatchSource:0}: Error finding container 58aceccdb43d9a30c011821bb226826b74d3417093cd639ccae20ed9147bfd03: Status 404 returned error can't find the container with id 58aceccdb43d9a30c011821bb226826b74d3417093cd639ccae20ed9147bfd03 Sep 10 17:25:48.356093 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:48.356063 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:48.834929 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:48.834905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9mv4" event={"ID":"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9","Type":"ContainerStarted","Data":"d5e307814ced4908d916b0c54def4d7fbd3927a0b2aeaaeaf576de0c513cbd58"} Sep 10 17:25:48.835016 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:48.834954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9mv4" event={"ID":"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9","Type":"ContainerStarted","Data":"58aceccdb43d9a30c011821bb226826b74d3417093cd639ccae20ed9147bfd03"} Sep 10 17:25:49.840995 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:49.840954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9mv4" event={"ID":"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9","Type":"ContainerStarted","Data":"75745e6f1aafc45d1b953cfb60a8cdebb08523d33559e5416352192bae1fd737"} Sep 10 17:25:50.846452 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:50.846418 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9mv4" event={"ID":"39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9","Type":"ContainerStarted","Data":"86ef4234e6308092e735c308dcb0336eafda02e312e00a113bc296567106ddb3"} Sep 10 17:25:50.865264 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:50.865218 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j9mv4" podStartSLOduration=17.697441886 podStartE2EDuration="19.865197513s" totalImagesPullingTime="2.167755627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:25:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:50.863610191 +0000 UTC m=+117.883537342" watchObservedRunningTime="2026-09-10 17:25:50.865197513 +0000 UTC m=+117.885124720" Sep 10 17:25:55.301399 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:55.301352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:55.415866 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:55.415836 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:55.606092 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:55.606006 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:55.977029 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:55.976989 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:56.077782 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:56.077750 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:56.183809 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:56.183781 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:56.417556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:56.417491 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:56.517863 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:56.517833 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:56.793063 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:56.793031 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:57.211939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.211915 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:57.236071 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.236046 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc"] Sep 10 17:25:57.238251 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.238234 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.240534 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.240511 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 17:25:57.240712 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.240695 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 17:25:57.240856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.240840 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 17:25:57.244853 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.244825 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 17:25:57.244954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.244910 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pw45c\"" Sep 10 17:25:57.256582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.256556 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc"] Sep 10 17:25:57.273106 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.273084 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6847f7bdd8-8trbb"] Sep 10 17:25:57.274871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.274854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.277152 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.277136 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kwhpq\"" Sep 10 17:25:57.277152 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.277144 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 17:25:57.277297 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.277221 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 17:25:57.277479 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.277464 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 17:25:57.282268 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.282250 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 17:25:57.290473 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.290451 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6847f7bdd8-8trbb"] Sep 10 17:25:57.294373 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.294356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013af9ac-16cf-4fea-a985-cacd8f888943-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86978567d4-72csc\" (UID: \"013af9ac-16cf-4fea-a985-cacd8f888943\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.294454 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.294439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmplz\" (UniqueName: \"kubernetes.io/projected/013af9ac-16cf-4fea-a985-cacd8f888943-kube-api-access-fmplz\") pod \"managed-serviceaccount-addon-agent-86978567d4-72csc\" (UID: \"013af9ac-16cf-4fea-a985-cacd8f888943\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.377539 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.377507 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:57.395285 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-registry-tls\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.395350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395290 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c25f0ce7-f3ab-434b-b5f6-00dc22791142-registry-certificates\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.395350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c25f0ce7-f3ab-434b-b5f6-00dc22791142-installation-pull-secrets\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.395350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-bound-sa-token\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.395460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmplz\" (UniqueName: \"kubernetes.io/projected/013af9ac-16cf-4fea-a985-cacd8f888943-kube-api-access-fmplz\") pod \"managed-serviceaccount-addon-agent-86978567d4-72csc\" (UID: \"013af9ac-16cf-4fea-a985-cacd8f888943\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.395460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5t44\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-kube-api-access-f5t44\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.395460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013af9ac-16cf-4fea-a985-cacd8f888943-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86978567d4-72csc\" (UID: \"013af9ac-16cf-4fea-a985-cacd8f888943\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.395460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c25f0ce7-f3ab-434b-b5f6-00dc22791142-ca-trust-extracted\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.395460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c25f0ce7-f3ab-434b-b5f6-00dc22791142-trusted-ca\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.395623 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.395476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c25f0ce7-f3ab-434b-b5f6-00dc22791142-image-registry-private-configuration\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.399938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.397957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013af9ac-16cf-4fea-a985-cacd8f888943-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86978567d4-72csc\" (UID: \"013af9ac-16cf-4fea-a985-cacd8f888943\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.407869 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.407846 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmplz\" (UniqueName: \"kubernetes.io/projected/013af9ac-16cf-4fea-a985-cacd8f888943-kube-api-access-fmplz\") pod \"managed-serviceaccount-addon-agent-86978567d4-72csc\" (UID: \"013af9ac-16cf-4fea-a985-cacd8f888943\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.476887 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.476829 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:57.495760 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c25f0ce7-f3ab-434b-b5f6-00dc22791142-ca-trust-extracted\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.495844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c25f0ce7-f3ab-434b-b5f6-00dc22791142-trusted-ca\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.495844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c25f0ce7-f3ab-434b-b5f6-00dc22791142-image-registry-private-configuration\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.495844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-registry-tls\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.495844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c25f0ce7-f3ab-434b-b5f6-00dc22791142-registry-certificates\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.496036 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c25f0ce7-f3ab-434b-b5f6-00dc22791142-installation-pull-secrets\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.496036 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-bound-sa-token\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.496036 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.495918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5t44\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-kube-api-access-f5t44\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.496322 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.496304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c25f0ce7-f3ab-434b-b5f6-00dc22791142-ca-trust-extracted\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.496796 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.496744 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c25f0ce7-f3ab-434b-b5f6-00dc22791142-registry-certificates\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.496796 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.496786 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c25f0ce7-f3ab-434b-b5f6-00dc22791142-trusted-ca\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.498299 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.498280 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c25f0ce7-f3ab-434b-b5f6-00dc22791142-installation-pull-secrets\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.498742 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.498720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c25f0ce7-f3ab-434b-b5f6-00dc22791142-image-registry-private-configuration\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.498832 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.498770 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-registry-tls\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.504291 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.504271 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5t44\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-kube-api-access-f5t44\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.504375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.504315 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c25f0ce7-f3ab-434b-b5f6-00dc22791142-bound-sa-token\") pod \"image-registry-6847f7bdd8-8trbb\" (UID: \"c25f0ce7-f3ab-434b-b5f6-00dc22791142\") " pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.557511 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.557486 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" Sep 10 17:25:57.584241 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.584222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:57.823555 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.823533 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc"] Sep 10 17:25:57.826023 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:25:57.825999 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod013af9ac_16cf_4fea_a985_cacd8f888943.slice/crio-6db371e82f74139db966b486f1b0d214fd51a5668ec75c3c3756e2db925e51d7 WatchSource:0}: Error finding container 6db371e82f74139db966b486f1b0d214fd51a5668ec75c3c3756e2db925e51d7: Status 404 returned error can't find the container with id 6db371e82f74139db966b486f1b0d214fd51a5668ec75c3c3756e2db925e51d7 Sep 10 17:25:57.859180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.859155 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6847f7bdd8-8trbb"] Sep 10 17:25:57.861857 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:25:57.861838 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25f0ce7_f3ab_434b_b5f6_00dc22791142.slice/crio-ccc023da703a3bb663cc9ceeeb0cfea668e6a7918423ae5e7164a3935d7a93d0 WatchSource:0}: Error finding container ccc023da703a3bb663cc9ceeeb0cfea668e6a7918423ae5e7164a3935d7a93d0: Status 404 returned error can't find the container with id ccc023da703a3bb663cc9ceeeb0cfea668e6a7918423ae5e7164a3935d7a93d0 Sep 10 17:25:57.869280 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.869257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" event={"ID":"c25f0ce7-f3ab-434b-b5f6-00dc22791142","Type":"ContainerStarted","Data":"ccc023da703a3bb663cc9ceeeb0cfea668e6a7918423ae5e7164a3935d7a93d0"} Sep 10 17:25:57.870260 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.870236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" event={"ID":"013af9ac-16cf-4fea-a985-cacd8f888943","Type":"ContainerStarted","Data":"6db371e82f74139db966b486f1b0d214fd51a5668ec75c3c3756e2db925e51d7"} Sep 10 17:25:57.879984 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:57.879960 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:58.229580 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:58.229540 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:58.331998 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:58.331962 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:58.883203 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:58.883166 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" event={"ID":"c25f0ce7-f3ab-434b-b5f6-00dc22791142","Type":"ContainerStarted","Data":"629b3e3794926e6723fe7ff0d949a2535592f9c482cfe27d92b4ec7e66ea76c2"} Sep 10 17:25:58.883701 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:58.883594 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:25:58.901734 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:58.901601 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podStartSLOduration=1.901585549 podStartE2EDuration="1.901585549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:58.900872856 +0000 UTC m=+125.920800009" watchObservedRunningTime="2026-09-10 17:25:58.901585549 +0000 UTC m=+125.921512702" Sep 10 17:25:59.411544 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.411505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:59.411544 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.411550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:59.412230 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.412206 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9758fc6-dc5e-4d88-860b-31572756f191-service-ca-bundle\") pod \"router-default-9d87c44-k7klw\" (UID: \"a9758fc6-dc5e-4d88-860b-31572756f191\") " pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:25:59.414184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.414156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed305f05-d529-4541-8b6a-99335447658e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-p9qfk\" (UID: \"ed305f05-d529-4541-8b6a-99335447658e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:59.544933 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.544897 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:59.607314 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.607274 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:59.673266 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.673205 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:25:59.706154 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.706126 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tjsdd\"" Sep 10 17:25:59.712614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.712594 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gbkrd\"" Sep 10 17:25:59.714308 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.714288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" Sep 10 17:25:59.721621 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:25:59.721590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:26:00.589261 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:00.589193 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk"] Sep 10 17:26:00.592349 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:00.592315 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded305f05_d529_4541_8b6a_99335447658e.slice/crio-d9eb02c5d7d357cc786d16173ca03f728980701c8ebd67bd6afcdf08ef1d928e WatchSource:0}: Error finding container d9eb02c5d7d357cc786d16173ca03f728980701c8ebd67bd6afcdf08ef1d928e: Status 404 returned error can't find the container with id d9eb02c5d7d357cc786d16173ca03f728980701c8ebd67bd6afcdf08ef1d928e Sep 10 17:26:00.592666 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:00.592630 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9d87c44-k7klw"] Sep 10 17:26:00.595490 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:00.595470 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9758fc6_dc5e_4d88_860b_31572756f191.slice/crio-adee342b4dea20afe7ed11bb87d86840a16f291e24d72bda0a42b8b98a2365cd WatchSource:0}: Error finding container adee342b4dea20afe7ed11bb87d86840a16f291e24d72bda0a42b8b98a2365cd: Status 404 returned error can't find the container with id adee342b4dea20afe7ed11bb87d86840a16f291e24d72bda0a42b8b98a2365cd Sep 10 17:26:00.891100 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:00.891038 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" event={"ID":"ed305f05-d529-4541-8b6a-99335447658e","Type":"ContainerStarted","Data":"d9eb02c5d7d357cc786d16173ca03f728980701c8ebd67bd6afcdf08ef1d928e"} Sep 10 17:26:00.892468 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:00.892435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" event={"ID":"013af9ac-16cf-4fea-a985-cacd8f888943","Type":"ContainerStarted","Data":"2e1ad24e53abf8a0cdc322b0e75cb7c2b1c021df5fa514e76401cdc23bf7d4a8"} Sep 10 17:26:00.893926 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:00.893907 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9d87c44-k7klw" event={"ID":"a9758fc6-dc5e-4d88-860b-31572756f191","Type":"ContainerStarted","Data":"76640d4e61d6467552180c3efe41df9ac5f5b15222da69624b3f6dcde8310da1"} Sep 10 17:26:00.894002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:00.893941 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9d87c44-k7klw" event={"ID":"a9758fc6-dc5e-4d88-860b-31572756f191","Type":"ContainerStarted","Data":"adee342b4dea20afe7ed11bb87d86840a16f291e24d72bda0a42b8b98a2365cd"} Sep 10 17:26:00.910881 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:00.910840 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86978567d4-72csc" podStartSLOduration=1.358462655 podStartE2EDuration="3.910826567s" totalImagesPullingTime="2.552363912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:00.910126815 +0000 UTC m=+127.930053980" watchObservedRunningTime="2026-09-10 17:26:00.910826567 +0000 UTC m=+127.930753710" Sep 10 17:26:01.722682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:01.722632 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:26:01.725114 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:01.725088 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:26:01.743244 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:01.743206 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9d87c44-k7klw" podStartSLOduration=34.743192005 podStartE2EDuration="34.743192005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:00.934340912 +0000 UTC m=+127.954268063" watchObservedRunningTime="2026-09-10 17:26:01.743192005 +0000 UTC m=+128.763119157" Sep 10 17:26:01.898861 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:01.898803 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:26:01.899971 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:01.899947 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9d87c44-k7klw" Sep 10 17:26:02.910226 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:02.910136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" event={"ID":"ed305f05-d529-4541-8b6a-99335447658e","Type":"ContainerStarted","Data":"af352eef301752dfb344c24c608b636d57490615e4e6b4486329ede660b5437e"} Sep 10 17:26:02.911992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:02.911962 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:02.937467 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:02.937427 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-p9qfk" podStartSLOduration=33.956237394 podStartE2EDuration="35.937415116s" totalImagesPullingTime="1.981177722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:02.936530159 +0000 UTC m=+129.956457313" watchObservedRunningTime="2026-09-10 17:26:02.937415116 +0000 UTC m=+129.957342291" Sep 10 17:26:03.010579 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.010559 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.122092 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.122061 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.245683 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.245625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:26:03.247971 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.247946 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2636c52-57f6-452e-af71-f5dfe97c3335-metrics-certs\") pod \"network-metrics-daemon-vx8dz\" (UID: \"b2636c52-57f6-452e-af71-f5dfe97c3335\") " pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:26:03.400767 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.400730 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.492465 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.492436 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.539418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.539363 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qjn9k\"" Sep 10 17:26:03.547169 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.547149 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx8dz" Sep 10 17:26:03.576959 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.576924 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.683744 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.683714 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.801192 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.801116 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.817576 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.817551 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vx8dz"] Sep 10 17:26:03.822124 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:03.822102 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2636c52_57f6_452e_af71_f5dfe97c3335.slice/crio-337009fc182110c4d81223c65f1122d71e327eb9f8eecfd6b4a5704e0db6d946 WatchSource:0}: Error finding container 337009fc182110c4d81223c65f1122d71e327eb9f8eecfd6b4a5704e0db6d946: Status 404 returned error can't find the container with id 337009fc182110c4d81223c65f1122d71e327eb9f8eecfd6b4a5704e0db6d946 Sep 10 17:26:03.835914 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.835894 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b55ffd4f9-g5x7q"] Sep 10 17:26:03.838317 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.838302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:03.840394 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.840374 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 17:26:03.840505 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.840462 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 17:26:03.840505 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.840485 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 17:26:03.841030 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.841013 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 17:26:03.841100 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.841057 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7pmmj\"" Sep 10 17:26:03.841303 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.841287 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 17:26:03.841362 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.841305 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 17:26:03.841419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.841389 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 17:26:03.851746 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.851727 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b55ffd4f9-g5x7q"] Sep 10 17:26:03.878930 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.878903 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:03.914445 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.914415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx8dz" event={"ID":"b2636c52-57f6-452e-af71-f5dfe97c3335","Type":"ContainerStarted","Data":"337009fc182110c4d81223c65f1122d71e327eb9f8eecfd6b4a5704e0db6d946"} Sep 10 17:26:03.951145 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.951116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-oauth-config\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:03.951241 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.951176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-config\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:03.951241 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.951204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84mnt\" (UniqueName: \"kubernetes.io/projected/d1d4dd53-7a37-4d48-9533-04b90e1fba86-kube-api-access-84mnt\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:03.951350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.951284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-oauth-serving-cert\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:03.951350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.951317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-serving-cert\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:03.951453 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:03.951367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-service-ca\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.052494 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.052413 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-serving-cert\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.052494 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.052465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-service-ca\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.052681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.052505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-oauth-config\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.052748 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.052706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-config\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.052748 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.052741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84mnt\" (UniqueName: \"kubernetes.io/projected/d1d4dd53-7a37-4d48-9533-04b90e1fba86-kube-api-access-84mnt\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.052856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.052826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-oauth-serving-cert\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.053408 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.053381 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-service-ca\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.053700 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.053468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-oauth-serving-cert\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.053700 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.053516 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-config\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.055196 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.055172 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-serving-cert\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.055270 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.055246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-oauth-config\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.061869 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.061849 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84mnt\" (UniqueName: \"kubernetes.io/projected/d1d4dd53-7a37-4d48-9533-04b90e1fba86-kube-api-access-84mnt\") pod \"console-5b55ffd4f9-g5x7q\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.147581 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.147552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:04.425767 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.425688 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b55ffd4f9-g5x7q"] Sep 10 17:26:04.606802 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:04.606771 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d4dd53_7a37_4d48_9533_04b90e1fba86.slice/crio-5d7a27e475e85ca3fee889391c390a6a85367b13eefe13753a13ab0286f7100c WatchSource:0}: Error finding container 5d7a27e475e85ca3fee889391c390a6a85367b13eefe13753a13ab0286f7100c: Status 404 returned error can't find the container with id 5d7a27e475e85ca3fee889391c390a6a85367b13eefe13753a13ab0286f7100c Sep 10 17:26:04.919194 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.919157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx8dz" event={"ID":"b2636c52-57f6-452e-af71-f5dfe97c3335","Type":"ContainerStarted","Data":"01ffd0f54116890e6ea8d2d1fbb8910301e68d2ece8821115b5f0c09c9bf5986"} Sep 10 17:26:04.919578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.919229 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx8dz" event={"ID":"b2636c52-57f6-452e-af71-f5dfe97c3335","Type":"ContainerStarted","Data":"6a253099d56695dfaaa00426201c552baf554719053ac2acdd68aab4f610d6e2"} Sep 10 17:26:04.920488 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.920464 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b55ffd4f9-g5x7q" event={"ID":"d1d4dd53-7a37-4d48-9533-04b90e1fba86","Type":"ContainerStarted","Data":"5d7a27e475e85ca3fee889391c390a6a85367b13eefe13753a13ab0286f7100c"} Sep 10 17:26:04.934509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:04.934410 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vx8dz" podStartSLOduration=131.119112943 podStartE2EDuration="2m11.934394774s" totalImagesPullingTime="815.281831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:04.933941061 +0000 UTC m=+131.953868213" watchObservedRunningTime="2026-09-10 17:26:04.934394774 +0000 UTC m=+131.954321904" Sep 10 17:26:05.222351 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:05.222317 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:05.599130 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:05.599055 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:05.661568 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:05.661543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:07.135746 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.135712 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:07.171150 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.171118 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-nltb4"] Sep 10 17:26:07.174809 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.174789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.177055 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.176952 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 17:26:07.177055 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.177020 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 17:26:07.177780 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.177759 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 17:26:07.177920 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.177817 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rq6xh\"" Sep 10 17:26:07.184947 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.184404 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-nltb4"] Sep 10 17:26:07.204453 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.204423 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:07.280592 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.280559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688121c1-46c4-41e0-a596-1fb4d7cda1c6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.280748 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.280613 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.280748 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.280691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.280748 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.280730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc42d\" (UniqueName: \"kubernetes.io/projected/688121c1-46c4-41e0-a596-1fb4d7cda1c6-kube-api-access-pc42d\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.382133 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.382097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.382300 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.382159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc42d\" (UniqueName: \"kubernetes.io/projected/688121c1-46c4-41e0-a596-1fb4d7cda1c6-kube-api-access-pc42d\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.382300 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.382244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688121c1-46c4-41e0-a596-1fb4d7cda1c6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.382425 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.382299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.383088 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:07.382936 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 17:26:07.383088 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:07.383013 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-tls podName:688121c1-46c4-41e0-a596-1fb4d7cda1c6 nodeName:}" failed. No retries permitted until 2026-09-10 17:26:07.882992864 +0000 UTC m=+134.902920000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-nltb4" (UID: "688121c1-46c4-41e0-a596-1fb4d7cda1c6") : secret "prometheus-operator-tls" not found Sep 10 17:26:07.383612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.383579 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688121c1-46c4-41e0-a596-1fb4d7cda1c6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.385123 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.385092 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.391898 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.391839 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc42d\" (UniqueName: \"kubernetes.io/projected/688121c1-46c4-41e0-a596-1fb4d7cda1c6-kube-api-access-pc42d\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.527504 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.527387 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:07.632034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.631980 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:07.694442 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.694350 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:07.887771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.887735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:07.890155 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:07.890127 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/688121c1-46c4-41e0-a596-1fb4d7cda1c6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-nltb4\" (UID: \"688121c1-46c4-41e0-a596-1fb4d7cda1c6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:08.087561 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:08.087530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" Sep 10 17:26:08.355964 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:08.355895 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-nltb4"] Sep 10 17:26:08.358835 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:08.358811 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688121c1_46c4_41e0_a596_1fb4d7cda1c6.slice/crio-9ae8ab8e2228137e4d478a175f4662465a9a7963c4b022bd9ba25cae0f4a0c0a WatchSource:0}: Error finding container 9ae8ab8e2228137e4d478a175f4662465a9a7963c4b022bd9ba25cae0f4a0c0a: Status 404 returned error can't find the container with id 9ae8ab8e2228137e4d478a175f4662465a9a7963c4b022bd9ba25cae0f4a0c0a Sep 10 17:26:08.940943 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:08.940904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b55ffd4f9-g5x7q" event={"ID":"d1d4dd53-7a37-4d48-9533-04b90e1fba86","Type":"ContainerStarted","Data":"c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4"} Sep 10 17:26:08.942477 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:08.942425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" event={"ID":"688121c1-46c4-41e0-a596-1fb4d7cda1c6","Type":"ContainerStarted","Data":"9ae8ab8e2228137e4d478a175f4662465a9a7963c4b022bd9ba25cae0f4a0c0a"} Sep 10 17:26:08.958076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:08.958004 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b55ffd4f9-g5x7q" podStartSLOduration=2.639234068 podStartE2EDuration="5.957984414s" totalImagesPullingTime="3.318750346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:08.956756562 +0000 UTC m=+135.976683746" watchObservedRunningTime="2026-09-10 17:26:08.957984414 +0000 UTC m=+135.977911568" Sep 10 17:26:09.916904 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:09.916819 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:09.947242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:09.947207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" event={"ID":"688121c1-46c4-41e0-a596-1fb4d7cda1c6","Type":"ContainerStarted","Data":"b22d7babde750a13f01c67744dd25d79f5dcf7c27c3e96b1aafc834e6a5b9e9b"} Sep 10 17:26:09.947347 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:09.947258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" event={"ID":"688121c1-46c4-41e0-a596-1fb4d7cda1c6","Type":"ContainerStarted","Data":"0d89ac5da7ef9882f718bf2a96271bf29e520d804d1e81df1508a3323ab6c6cb"} Sep 10 17:26:09.963617 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:09.963181 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-nltb4" podStartSLOduration=1.678432336 podStartE2EDuration="2.963160285s" totalImagesPullingTime="1.284727949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:09.962839199 +0000 UTC m=+136.982766352" watchObservedRunningTime="2026-09-10 17:26:09.963160285 +0000 UTC m=+136.983087439" Sep 10 17:26:10.820504 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:10.820472 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:10.883954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:10.883916 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:11.286709 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.286677 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:11.456675 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.456624 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:11.553041 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.552958 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:11.554475 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.554451 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt"] Sep 10 17:26:11.557821 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.557806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.560524 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.560504 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 17:26:11.560602 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.560507 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 17:26:11.560689 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.560588 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-z9vjc\"" Sep 10 17:26:11.571103 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.571083 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt"] Sep 10 17:26:11.601308 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.601281 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2nblv"] Sep 10 17:26:11.604580 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.604562 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.607521 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.607505 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v58mw\"" Sep 10 17:26:11.608003 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.607987 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 17:26:11.608171 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.608155 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 17:26:11.608332 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.608315 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 17:26:11.642144 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.642121 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:11.719278 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.719369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-metrics-client-ca\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-tls\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-textfile\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134198fc-ea5d-4d91-8af6-1f28186c48a3-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.719508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4l2\" (UniqueName: \"kubernetes.io/projected/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-kube-api-access-gk4l2\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-sys\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-wtmp\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-root\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.719846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfclt\" (UniqueName: \"kubernetes.io/projected/134198fc-ea5d-4d91-8af6-1f28186c48a3-kube-api-access-wfclt\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.719846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.719846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.719770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.772596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.772573 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:11.820873 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.820812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-root\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.820873 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.820853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfclt\" (UniqueName: \"kubernetes.io/projected/134198fc-ea5d-4d91-8af6-1f28186c48a3-kube-api-access-wfclt\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.821022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.820885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.821022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.820910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.820911 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-root\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.820959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.821022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-metrics-client-ca\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-tls\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:11.821042 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-textfile\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134198fc-ea5d-4d91-8af6-1f28186c48a3-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:11.821112 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-tls podName:134198fc-ea5d-4d91-8af6-1f28186c48a3 nodeName:}" failed. No retries permitted until 2026-09-10 17:26:12.321092143 +0000 UTC m=+139.341019288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-tfnzt" (UID: "134198fc-ea5d-4d91-8af6-1f28186c48a3") : secret "openshift-state-metrics-tls" not found Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4l2\" (UniqueName: \"kubernetes.io/projected/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-kube-api-access-gk4l2\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-sys\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-wtmp\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821705 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821316 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-sys\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821705 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:11.821154 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 17:26:11.821705 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-textfile\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821705 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:11.821384 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-tls podName:9a3b02bf-c70a-4490-9fd9-674cf55c5f57 nodeName:}" failed. No retries permitted until 2026-09-10 17:26:12.321369254 +0000 UTC m=+139.341296412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-tls") pod "node-exporter-2nblv" (UID: "9a3b02bf-c70a-4490-9fd9-674cf55c5f57") : secret "node-exporter-tls" not found Sep 10 17:26:11.821705 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821472 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-wtmp\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821705 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821569 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821969 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821774 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-metrics-client-ca\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.821969 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.821852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134198fc-ea5d-4d91-8af6-1f28186c48a3-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.823388 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.823368 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.823533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.823512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.834515 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.834493 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfclt\" (UniqueName: \"kubernetes.io/projected/134198fc-ea5d-4d91-8af6-1f28186c48a3-kube-api-access-wfclt\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:11.834817 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.834802 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4l2\" (UniqueName: \"kubernetes.io/projected/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-kube-api-access-gk4l2\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:11.874348 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.874323 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:11.973837 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:11.973807 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:12.087409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.087358 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:12.325163 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.325130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:12.325543 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.325188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-tls\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:12.327665 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.327614 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a3b02bf-c70a-4490-9fd9-674cf55c5f57-node-exporter-tls\") pod \"node-exporter-2nblv\" (UID: \"9a3b02bf-c70a-4490-9fd9-674cf55c5f57\") " pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:12.327762 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.327618 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/134198fc-ea5d-4d91-8af6-1f28186c48a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-tfnzt\" (UID: \"134198fc-ea5d-4d91-8af6-1f28186c48a3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:12.466786 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.466764 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" Sep 10 17:26:12.498294 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.498263 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:12.513427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.513401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2nblv" Sep 10 17:26:12.533996 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:12.533912 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3b02bf_c70a_4490_9fd9_674cf55c5f57.slice/crio-d8ae4dd82c6ba46c3095c0d75744937c946a57b3902fd311b8130fe74499e376 WatchSource:0}: Error finding container d8ae4dd82c6ba46c3095c0d75744937c946a57b3902fd311b8130fe74499e376: Status 404 returned error can't find the container with id d8ae4dd82c6ba46c3095c0d75744937c946a57b3902fd311b8130fe74499e376 Sep 10 17:26:12.584488 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.584462 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:12.743394 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.743333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt"] Sep 10 17:26:12.746223 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:12.746193 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134198fc_ea5d_4d91_8af6_1f28186c48a3.slice/crio-703b1443c6c40a90c2a17066f784232d2c873206af44a7051325096b4773d95c WatchSource:0}: Error finding container 703b1443c6c40a90c2a17066f784232d2c873206af44a7051325096b4773d95c: Status 404 returned error can't find the container with id 703b1443c6c40a90c2a17066f784232d2c873206af44a7051325096b4773d95c Sep 10 17:26:12.801187 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.801153 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:12.963365 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.963316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nblv" event={"ID":"9a3b02bf-c70a-4490-9fd9-674cf55c5f57","Type":"ContainerStarted","Data":"d8ae4dd82c6ba46c3095c0d75744937c946a57b3902fd311b8130fe74499e376"} Sep 10 17:26:12.965323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.965293 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" event={"ID":"134198fc-ea5d-4d91-8af6-1f28186c48a3","Type":"ContainerStarted","Data":"eab9c6fb3413391d1e7791ca0e7344151cee526721e6c89af954a10f38c3e290"} Sep 10 17:26:12.965445 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.965338 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" event={"ID":"134198fc-ea5d-4d91-8af6-1f28186c48a3","Type":"ContainerStarted","Data":"4fc2cdc6f5004033a898188d226e6cd7a19b59c334078e51134416236cebd147"} Sep 10 17:26:12.965445 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:12.965355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" event={"ID":"134198fc-ea5d-4d91-8af6-1f28186c48a3","Type":"ContainerStarted","Data":"703b1443c6c40a90c2a17066f784232d2c873206af44a7051325096b4773d95c"} Sep 10 17:26:13.969632 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:13.969600 2580 generic.go:356] "Generic (PLEG): container finished" podID="9a3b02bf-c70a-4490-9fd9-674cf55c5f57" containerID="00f95a867880fb7336b6cead35dc1301e0150c02ffa649d885d22a19a048bf3d" exitCode=0 Sep 10 17:26:13.970067 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:13.969685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nblv" event={"ID":"9a3b02bf-c70a-4490-9fd9-674cf55c5f57","Type":"ContainerDied","Data":"00f95a867880fb7336b6cead35dc1301e0150c02ffa649d885d22a19a048bf3d"} Sep 10 17:26:14.148122 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.148094 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:14.148285 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.148148 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:14.149740 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.149712 2580 patch_prober.go:28] interesting pod/console-5b55ffd4f9-g5x7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Sep 10 17:26:14.149850 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.149774 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5b55ffd4f9-g5x7q" podUID="d1d4dd53-7a37-4d48-9533-04b90e1fba86" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Sep 10 17:26:14.227063 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.227028 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:14.462863 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.462820 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:14.553329 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.553247 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:14.750977 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.750946 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:14.850937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.850863 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:14.975922 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.975890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nblv" event={"ID":"9a3b02bf-c70a-4490-9fd9-674cf55c5f57","Type":"ContainerStarted","Data":"a7efafd7d0e30d5207ec3fc0932371a8e1576d6a4d199a43e0337b9f58895095"} Sep 10 17:26:14.976256 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.975944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nblv" event={"ID":"9a3b02bf-c70a-4490-9fd9-674cf55c5f57","Type":"ContainerStarted","Data":"eace3932d978eb6a535e6be2e758261ff2c0ed2842ec40fc69dc97e4af327fe7"} Sep 10 17:26:14.978159 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.978131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" event={"ID":"134198fc-ea5d-4d91-8af6-1f28186c48a3","Type":"ContainerStarted","Data":"588dd8461b6f629c76764c534d6a5140319063d7bce94922540af55a7860bf21"} Sep 10 17:26:14.996443 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:14.996399 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2nblv" podStartSLOduration=2.838528475 podStartE2EDuration="3.99638424s" totalImagesPullingTime="1.089753608s" totalInitContainerRuntime="68.102157ms" isStatefulPod=true podCreationTimestamp="2026-09-10 17:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:14.995101076 +0000 UTC m=+142.015028230" watchObservedRunningTime="2026-09-10 17:26:14.99638424 +0000 UTC m=+142.016311391" Sep 10 17:26:15.014332 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:15.014296 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-tfnzt" podStartSLOduration=2.65056563 podStartE2EDuration="4.014283036s" totalImagesPullingTime="1.363717406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:15.013217917 +0000 UTC m=+142.033145068" watchObservedRunningTime="2026-09-10 17:26:15.014283036 +0000 UTC m=+142.034210187" Sep 10 17:26:16.290840 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.290795 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:16.297374 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.297350 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz"] Sep 10 17:26:16.300775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.300759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.302740 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.302716 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 17:26:16.302835 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.302808 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5wkb2\"" Sep 10 17:26:16.306308 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.306286 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b55ffd4f9-g5x7q"] Sep 10 17:26:16.309474 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.309453 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz"] Sep 10 17:26:16.379414 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.379385 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:16.462172 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.462143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2qh4\" (UniqueName: \"kubernetes.io/projected/29b9affe-344a-45cd-978a-33946ff8aa80-kube-api-access-z2qh4\") pod \"monitoring-plugin-85bbbbbf4-fqmmz\" (UID: \"29b9affe-344a-45cd-978a-33946ff8aa80\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.462293 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.462196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29b9affe-344a-45cd-978a-33946ff8aa80-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-fqmmz\" (UID: \"29b9affe-344a-45cd-978a-33946ff8aa80\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.489738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.489704 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:16.562979 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.562922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2qh4\" (UniqueName: \"kubernetes.io/projected/29b9affe-344a-45cd-978a-33946ff8aa80-kube-api-access-z2qh4\") pod \"monitoring-plugin-85bbbbbf4-fqmmz\" (UID: \"29b9affe-344a-45cd-978a-33946ff8aa80\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.562979 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.562957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29b9affe-344a-45cd-978a-33946ff8aa80-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-fqmmz\" (UID: \"29b9affe-344a-45cd-978a-33946ff8aa80\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.565363 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.565342 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29b9affe-344a-45cd-978a-33946ff8aa80-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-fqmmz\" (UID: \"29b9affe-344a-45cd-978a-33946ff8aa80\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.570362 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.570342 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2qh4\" (UniqueName: \"kubernetes.io/projected/29b9affe-344a-45cd-978a-33946ff8aa80-kube-api-access-z2qh4\") pod \"monitoring-plugin-85bbbbbf4-fqmmz\" (UID: \"29b9affe-344a-45cd-978a-33946ff8aa80\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.610222 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.610201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:16.729719 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.729682 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d664986cd-xhb8b"] Sep 10 17:26:16.733465 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.733446 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.735522 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.735496 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 17:26:16.735522 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.735509 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rnd78\"" Sep 10 17:26:16.735768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.735535 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 17:26:16.735768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.735499 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 17:26:16.735768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.735509 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 17:26:16.736035 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.735857 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 17:26:16.740886 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.740866 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 17:26:16.746136 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.746117 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d664986cd-xhb8b"] Sep 10 17:26:16.866230 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-serving-certs-ca-bundle\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.866230 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866208 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.866346 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866246 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.866346 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-telemeter-client-tls\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.866346 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-secret-telemeter-client\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.866346 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-federate-client-tls\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.866457 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-metrics-client-ca\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.866457 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.866373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znpsk\" (UniqueName: \"kubernetes.io/projected/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-kube-api-access-znpsk\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.877160 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.877074 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz"] Sep 10 17:26:16.879762 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:16.879738 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b9affe_344a_45cd_978a_33946ff8aa80.slice/crio-bcf26884f0bc57bbf6e4cc8270c013d998225d44691a8a4cd71dc337b0f76d59 WatchSource:0}: Error finding container bcf26884f0bc57bbf6e4cc8270c013d998225d44691a8a4cd71dc337b0f76d59: Status 404 returned error can't find the container with id bcf26884f0bc57bbf6e4cc8270c013d998225d44691a8a4cd71dc337b0f76d59 Sep 10 17:26:16.967478 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-serving-certs-ca-bundle\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.967578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.967578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.967578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-telemeter-client-tls\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.967776 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-secret-telemeter-client\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.967776 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-federate-client-tls\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.967776 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-metrics-client-ca\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.967919 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.967807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znpsk\" (UniqueName: \"kubernetes.io/projected/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-kube-api-access-znpsk\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.968286 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.968259 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-serving-certs-ca-bundle\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.968559 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.968385 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-metrics-client-ca\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.968627 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.968599 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.970213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.970190 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.970315 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.970296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-telemeter-client-tls\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.970406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.970385 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-federate-client-tls\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.970542 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.970526 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-secret-telemeter-client\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.975702 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.975683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znpsk\" (UniqueName: \"kubernetes.io/projected/5ae9d0f2-a9f9-4325-b77b-1522163d7caf-kube-api-access-znpsk\") pod \"telemeter-client-d664986cd-xhb8b\" (UID: \"5ae9d0f2-a9f9-4325-b77b-1522163d7caf\") " pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:16.986477 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:16.986454 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" event={"ID":"29b9affe-344a-45cd-978a-33946ff8aa80","Type":"ContainerStarted","Data":"bcf26884f0bc57bbf6e4cc8270c013d998225d44691a8a4cd71dc337b0f76d59"} Sep 10 17:26:17.043282 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:17.043258 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" Sep 10 17:26:17.318882 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:17.318841 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d664986cd-xhb8b"] Sep 10 17:26:17.324076 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:17.324049 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae9d0f2_a9f9_4325_b77b_1522163d7caf.slice/crio-e59b9ff2b07f6aa78557aab515591947b36323b8eb8616cf866c2c49bcdf6975 WatchSource:0}: Error finding container e59b9ff2b07f6aa78557aab515591947b36323b8eb8616cf866c2c49bcdf6975: Status 404 returned error can't find the container with id e59b9ff2b07f6aa78557aab515591947b36323b8eb8616cf866c2c49bcdf6975 Sep 10 17:26:17.589630 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:17.589547 2580 patch_prober.go:28] interesting pod/image-registry-6847f7bdd8-8trbb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:26:17.589788 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:17.589655 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:26:17.707278 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:17.707230 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:17.992771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:17.992734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" event={"ID":"5ae9d0f2-a9f9-4325-b77b-1522163d7caf","Type":"ContainerStarted","Data":"e59b9ff2b07f6aa78557aab515591947b36323b8eb8616cf866c2c49bcdf6975"} Sep 10 17:26:18.997871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:18.997828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" event={"ID":"29b9affe-344a-45cd-978a-33946ff8aa80","Type":"ContainerStarted","Data":"d6ec3073b026bd20320b88b784c45196f19d44302c4aec4adf05278bdf855f8e"} Sep 10 17:26:18.998232 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:18.998015 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:19.002419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:19.002396 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" Sep 10 17:26:19.016612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:19.016567 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fqmmz" podStartSLOduration=1.589806193 podStartE2EDuration="3.016552891s" totalImagesPullingTime="1.426746698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:19.015729613 +0000 UTC m=+146.035656760" watchObservedRunningTime="2026-09-10 17:26:19.016552891 +0000 UTC m=+146.036480042" Sep 10 17:26:19.891948 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:19.891914 2580 patch_prober.go:28] interesting pod/image-registry-6847f7bdd8-8trbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:26:19.892125 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:19.891982 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:26:21.009445 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:21.009403 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" event={"ID":"5ae9d0f2-a9f9-4325-b77b-1522163d7caf","Type":"ContainerStarted","Data":"2a36b641b4298e1490775e63cdba7f6d5263e10065fede75769e0f1f3e4290eb"} Sep 10 17:26:22.015135 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:22.015094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" event={"ID":"5ae9d0f2-a9f9-4325-b77b-1522163d7caf","Type":"ContainerStarted","Data":"058aec68f2a17a8fa4a252659753adf3321e44e1b50fb4602bf55d6dec2027a0"} Sep 10 17:26:22.015497 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:22.015158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" event={"ID":"5ae9d0f2-a9f9-4325-b77b-1522163d7caf","Type":"ContainerStarted","Data":"136e9ddf40c49568685261bd117620a0384c548d26de4c2e884d076ee95a0cc9"} Sep 10 17:26:22.036467 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:22.036418 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d664986cd-xhb8b" podStartSLOduration=2.293096276 podStartE2EDuration="6.036405202s" totalImagesPullingTime="3.743308926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:22.035964391 +0000 UTC m=+149.055891580" watchObservedRunningTime="2026-09-10 17:26:22.036405202 +0000 UTC m=+149.056332353" Sep 10 17:26:26.294080 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:26.294045 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:27.588747 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:27.588715 2580 patch_prober.go:28] interesting pod/image-registry-6847f7bdd8-8trbb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:26:27.589101 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:27.588759 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:26:29.853818 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:29.853776 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wb4sd" podUID="f964bb89-dc3b-41b5-870d-5b45c48e543b" Sep 10 17:26:29.890711 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:29.890686 2580 patch_prober.go:28] interesting pod/image-registry-6847f7bdd8-8trbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:26:29.890838 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:29.890727 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:26:30.049416 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:30.049390 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wb4sd" Sep 10 17:26:31.123023 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:31.122990 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:31.221298 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:31.221267 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:34.708295 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:34.708259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:26:34.710541 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:34.710518 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f964bb89-dc3b-41b5-870d-5b45c48e543b-metrics-tls\") pod \"dns-default-wb4sd\" (UID: \"f964bb89-dc3b-41b5-870d-5b45c48e543b\") " pod="openshift-dns/dns-default-wb4sd" Sep 10 17:26:34.852460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:34.852438 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vn8bp\"" Sep 10 17:26:34.860275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:34.860259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wb4sd" Sep 10 17:26:35.177318 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:35.177294 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wb4sd"] Sep 10 17:26:35.179887 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:26:35.179848 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf964bb89_dc3b_41b5_870d_5b45c48e543b.slice/crio-70d12dac7361da8cebc109fa08ec90ea0bfd707af62cc51210e58bca6a55f67b WatchSource:0}: Error finding container 70d12dac7361da8cebc109fa08ec90ea0bfd707af62cc51210e58bca6a55f67b: Status 404 returned error can't find the container with id 70d12dac7361da8cebc109fa08ec90ea0bfd707af62cc51210e58bca6a55f67b Sep 10 17:26:35.852237 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:35.852203 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:35.953575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:35.953532 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:36.073088 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:36.073041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wb4sd" event={"ID":"f964bb89-dc3b-41b5-870d-5b45c48e543b","Type":"ContainerStarted","Data":"70d12dac7361da8cebc109fa08ec90ea0bfd707af62cc51210e58bca6a55f67b"} Sep 10 17:26:37.078141 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.078110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wb4sd" event={"ID":"f964bb89-dc3b-41b5-870d-5b45c48e543b","Type":"ContainerStarted","Data":"2292f394a480f9604d8c68b0467169cb0d090ed89efc009e3a1e647a00e8d7bb"} Sep 10 17:26:37.078587 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.078163 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wb4sd" event={"ID":"f964bb89-dc3b-41b5-870d-5b45c48e543b","Type":"ContainerStarted","Data":"2a8e4e2ee014e4075731f10ae466d1dee4466e63274ace7d2ccf93d1d76214e2"} Sep 10 17:26:37.078587 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.078196 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wb4sd" Sep 10 17:26:37.101587 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.095667 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wb4sd" podStartSLOduration=129.655312422 podStartE2EDuration="2m11.095624777s" totalImagesPullingTime="1.440312355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:37.095256395 +0000 UTC m=+164.115183551" watchObservedRunningTime="2026-09-10 17:26:37.095624777 +0000 UTC m=+164.115551932" Sep 10 17:26:37.588270 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.588242 2580 patch_prober.go:28] interesting pod/image-registry-6847f7bdd8-8trbb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:26:37.588415 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.588286 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:26:37.588415 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.588330 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:26:37.588784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.588739 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"629b3e3794926e6723fe7ff0d949a2535592f9c482cfe27d92b4ec7e66ea76c2"} pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" containerMessage="Container registry failed liveness probe, will be restarted" Sep 10 17:26:37.592310 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.592286 2580 patch_prober.go:28] interesting pod/image-registry-6847f7bdd8-8trbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:26:37.592310 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:37.592329 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:26:41.328265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:41.328224 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b55ffd4f9-g5x7q" podUID="d1d4dd53-7a37-4d48-9533-04b90e1fba86" containerName="console" containerID="cri-o://c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4" gracePeriod=15 Sep 10 17:26:45.409230 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:45.409143 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:45.513784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:45.513748 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:45.608193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:45.608166 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:45.668233 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:45.668141 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:47.084490 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:47.084463 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wb4sd" Sep 10 17:26:47.592717 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:47.592690 2580 patch_prober.go:28] interesting pod/image-registry-6847f7bdd8-8trbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:26:47.592873 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:47.592745 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:26:47.837413 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:47.837388 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:47.938275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:47.938199 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:48.261472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.261451 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:48.305627 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.305602 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84mnt\" (UniqueName: \"kubernetes.io/projected/d1d4dd53-7a37-4d48-9533-04b90e1fba86-kube-api-access-84mnt\") pod \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " Sep 10 17:26:48.305765 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.305631 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-service-ca\") pod \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " Sep 10 17:26:48.305765 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.305699 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-oauth-config\") pod \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " Sep 10 17:26:48.305765 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.305736 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-config\") pod \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " Sep 10 17:26:48.305896 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.305879 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-serving-cert\") pod \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " Sep 10 17:26:48.305947 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.305923 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-oauth-serving-cert\") pod \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\" (UID: \"d1d4dd53-7a37-4d48-9533-04b90e1fba86\") " Sep 10 17:26:48.306111 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.306086 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-config" (OuterVolumeSpecName: "console-config") pod "d1d4dd53-7a37-4d48-9533-04b90e1fba86" (UID: "d1d4dd53-7a37-4d48-9533-04b90e1fba86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:26:48.306449 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.306100 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1d4dd53-7a37-4d48-9533-04b90e1fba86" (UID: "d1d4dd53-7a37-4d48-9533-04b90e1fba86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:26:48.306449 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.306276 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1d4dd53-7a37-4d48-9533-04b90e1fba86" (UID: "d1d4dd53-7a37-4d48-9533-04b90e1fba86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:26:48.308025 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.307999 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1d4dd53-7a37-4d48-9533-04b90e1fba86" (UID: "d1d4dd53-7a37-4d48-9533-04b90e1fba86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:26:48.308130 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.308024 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1d4dd53-7a37-4d48-9533-04b90e1fba86" (UID: "d1d4dd53-7a37-4d48-9533-04b90e1fba86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:26:48.308130 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.308061 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d4dd53-7a37-4d48-9533-04b90e1fba86-kube-api-access-84mnt" (OuterVolumeSpecName: "kube-api-access-84mnt") pod "d1d4dd53-7a37-4d48-9533-04b90e1fba86" (UID: "d1d4dd53-7a37-4d48-9533-04b90e1fba86"). InnerVolumeSpecName "kube-api-access-84mnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:26:48.406612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.406587 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84mnt\" (UniqueName: \"kubernetes.io/projected/d1d4dd53-7a37-4d48-9533-04b90e1fba86-kube-api-access-84mnt\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:26:48.406612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.406607 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-service-ca\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:26:48.406764 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.406617 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-oauth-config\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:26:48.406764 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.406626 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-config\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:26:48.406764 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.406660 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d4dd53-7a37-4d48-9533-04b90e1fba86-console-serving-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:26:48.406764 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:48.406670 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1d4dd53-7a37-4d48-9533-04b90e1fba86-oauth-serving-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:26:49.122960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.122926 2580 generic.go:356] "Generic (PLEG): container finished" podID="d1d4dd53-7a37-4d48-9533-04b90e1fba86" containerID="c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4" exitCode=0 Sep 10 17:26:49.123126 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.122990 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b55ffd4f9-g5x7q" Sep 10 17:26:49.123126 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.123013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b55ffd4f9-g5x7q" event={"ID":"d1d4dd53-7a37-4d48-9533-04b90e1fba86","Type":"ContainerDied","Data":"c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4"} Sep 10 17:26:49.123126 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.123096 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b55ffd4f9-g5x7q" event={"ID":"d1d4dd53-7a37-4d48-9533-04b90e1fba86","Type":"ContainerDied","Data":"5d7a27e475e85ca3fee889391c390a6a85367b13eefe13753a13ab0286f7100c"} Sep 10 17:26:49.123126 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.123122 2580 scope.go:117] "RemoveContainer" containerID="c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4" Sep 10 17:26:49.133934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.133918 2580 scope.go:117] "RemoveContainer" containerID="c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4" Sep 10 17:26:49.134193 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:26:49.134172 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4\": container with ID starting with c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4 not found: ID does not exist" containerID="c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4" Sep 10 17:26:49.134262 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.134205 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4"} err="failed to get container status \"c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4\": rpc error: code = NotFound desc = could not find container \"c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4\": container with ID starting with c8392af8c246d1b58745441c435b4686673a8f0e8006752f19ec8ed7608389c4 not found: ID does not exist" Sep 10 17:26:49.145957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.145939 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b55ffd4f9-g5x7q"] Sep 10 17:26:49.149467 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.149446 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b55ffd4f9-g5x7q"] Sep 10 17:26:49.399168 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.399069 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:49.430773 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.430751 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1d4dd53-7a37-4d48-9533-04b90e1fba86" path="/var/lib/kubelet/pods/d1d4dd53-7a37-4d48-9533-04b90e1fba86/volumes" Sep 10 17:26:49.457019 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:49.456994 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:52.136822 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.136791 2580 generic.go:356] "Generic (PLEG): container finished" podID="fdfc6c25-6050-4909-bc9f-f493c7f81ff1" containerID="ac318cd145a99e9db90e6521d254ecc4b6ecac2bb597724136cf7cd2bcb84d6a" exitCode=0 Sep 10 17:26:52.137204 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.136866 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" event={"ID":"fdfc6c25-6050-4909-bc9f-f493c7f81ff1","Type":"ContainerDied","Data":"ac318cd145a99e9db90e6521d254ecc4b6ecac2bb597724136cf7cd2bcb84d6a"} Sep 10 17:26:52.137204 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.137183 2580 scope.go:117] "RemoveContainer" containerID="ac318cd145a99e9db90e6521d254ecc4b6ecac2bb597724136cf7cd2bcb84d6a" Sep 10 17:26:52.138514 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.138482 2580 generic.go:356] "Generic (PLEG): container finished" podID="abef3868-6891-4c5e-8e7f-15fe407e3688" containerID="dec6dcfe9d12ae4aea84d418c1e70818c378a5c07f89717b72a0bdfdf445951b" exitCode=0 Sep 10 17:26:52.138604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.138538 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" event={"ID":"abef3868-6891-4c5e-8e7f-15fe407e3688","Type":"ContainerDied","Data":"dec6dcfe9d12ae4aea84d418c1e70818c378a5c07f89717b72a0bdfdf445951b"} Sep 10 17:26:52.138838 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.138823 2580 scope.go:117] "RemoveContainer" containerID="dec6dcfe9d12ae4aea84d418c1e70818c378a5c07f89717b72a0bdfdf445951b" Sep 10 17:26:52.713023 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.712981 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:52.821890 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.821861 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:52.916533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:52.916452 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:53.123555 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:53.123466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:53.145490 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:53.145461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-gnh6v" event={"ID":"fdfc6c25-6050-4909-bc9f-f493c7f81ff1","Type":"ContainerStarted","Data":"1e962897a395db42021743840de11d3b547d5b9f618f7c80e8c6230048f7d0ef"} Sep 10 17:26:53.147672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:53.147617 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-xpb6t" event={"ID":"abef3868-6891-4c5e-8e7f-15fe407e3688","Type":"ContainerStarted","Data":"94674f28ac509dd0ee7c89cb4091a5af4af026a1ba49c147db8c4d9f578d81fc"} Sep 10 17:26:53.321254 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:53.321222 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:53.853427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:53.853396 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:53.954619 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:53.954584 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:55.795190 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:55.795159 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-p9qfk_ed305f05-d529-4541-8b6a-99335447658e/cluster-monitoring-operator/0.log" Sep 10 17:26:56.792165 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:56.792140 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-fqmmz_29b9affe-344a-45cd-978a-33946ff8aa80/monitoring-plugin/0.log" Sep 10 17:26:56.996602 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:56.996574 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nblv_9a3b02bf-c70a-4490-9fd9-674cf55c5f57/init-textfile/0.log" Sep 10 17:26:57.192793 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:57.192710 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nblv_9a3b02bf-c70a-4490-9fd9-674cf55c5f57/node-exporter/0.log" Sep 10 17:26:57.391528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:57.391498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nblv_9a3b02bf-c70a-4490-9fd9-674cf55c5f57/kube-rbac-proxy/0.log" Sep 10 17:26:57.593349 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:57.593322 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:26:57.731565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:57.731528 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:57.833178 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:57.833146 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:57.892622 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:57.892549 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:58.521846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:58.521798 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:58.621587 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:58.621554 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:26:58.792220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:58.792135 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-tfnzt_134198fc-ea5d-4d91-8af6-1f28186c48a3/kube-rbac-proxy-main/0.log" Sep 10 17:26:58.991571 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:58.991521 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-tfnzt_134198fc-ea5d-4d91-8af6-1f28186c48a3/kube-rbac-proxy-self/0.log" Sep 10 17:26:59.191779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:26:59.191685 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-tfnzt_134198fc-ea5d-4d91-8af6-1f28186c48a3/openshift-state-metrics/0.log" Sep 10 17:27:00.796771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:00.796731 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-nltb4_688121c1-46c4-41e0-a596-1fb4d7cda1c6/prometheus-operator/0.log" Sep 10 17:27:00.992132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:00.992099 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-nltb4_688121c1-46c4-41e0-a596-1fb4d7cda1c6/kube-rbac-proxy/0.log" Sep 10 17:27:01.392521 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:01.392492 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d664986cd-xhb8b_5ae9d0f2-a9f9-4325-b77b-1522163d7caf/telemeter-client/0.log" Sep 10 17:27:01.593006 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:01.592975 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d664986cd-xhb8b_5ae9d0f2-a9f9-4325-b77b-1522163d7caf/reload/0.log" Sep 10 17:27:01.794432 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:01.794405 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d664986cd-xhb8b_5ae9d0f2-a9f9-4325-b77b-1522163d7caf/kube-rbac-proxy/0.log" Sep 10 17:27:02.608625 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:02.608582 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" podUID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerName="registry" containerID="cri-o://629b3e3794926e6723fe7ff0d949a2535592f9c482cfe27d92b4ec7e66ea76c2" gracePeriod=30 Sep 10 17:27:02.847633 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:02.847595 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:02.946578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:02.946482 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:04.192919 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:04.192881 2580 generic.go:356] "Generic (PLEG): container finished" podID="c25f0ce7-f3ab-434b-b5f6-00dc22791142" containerID="629b3e3794926e6723fe7ff0d949a2535592f9c482cfe27d92b4ec7e66ea76c2" exitCode=0 Sep 10 17:27:04.193306 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:04.192944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" event={"ID":"c25f0ce7-f3ab-434b-b5f6-00dc22791142","Type":"ContainerDied","Data":"629b3e3794926e6723fe7ff0d949a2535592f9c482cfe27d92b4ec7e66ea76c2"} Sep 10 17:27:04.193306 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:04.193026 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" event={"ID":"c25f0ce7-f3ab-434b-b5f6-00dc22791142","Type":"ContainerStarted","Data":"97b8b0c5dddd6d9d97fdd6f54b1e9eff6968e5dac444f3839dc4ca2e6de20785"} Sep 10 17:27:04.193306 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:04.193056 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:27:04.373027 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:04.372993 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:04.473891 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:04.473860 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:05.205624 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:05.205598 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wb4sd_f964bb89-dc3b-41b5-870d-5b45c48e543b/dns/0.log" Sep 10 17:27:05.392444 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:05.392415 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wb4sd_f964bb89-dc3b-41b5-870d-5b45c48e543b/kube-rbac-proxy/0.log" Sep 10 17:27:05.792378 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:05.792350 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bvpp_c93b03a1-a891-40ae-ac9e-b12918218e6b/dns-node-resolver/0.log" Sep 10 17:27:06.392216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:06.392183 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6847f7bdd8-8trbb_c25f0ce7-f3ab-434b-b5f6-00dc22791142/registry/1.log" Sep 10 17:27:06.791876 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:06.791853 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jp7bx_9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105/node-ca/0.log" Sep 10 17:27:07.194560 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:07.194500 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-7ntzf_c78ee545-f850-4982-9d1b-cad6ef2a2afe/cluster-samples-operator/0.log" Sep 10 17:27:07.393664 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:07.393624 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-7ntzf_c78ee545-f850-4982-9d1b-cad6ef2a2afe/cluster-samples-operator-watch/0.log" Sep 10 17:27:11.080936 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:11.080904 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:12.460327 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:12.460288 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:17.841782 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:17.841750 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:17.939260 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:17.939224 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:25.201708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:25.201681 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6847f7bdd8-8trbb" Sep 10 17:27:25.437986 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:25.437948 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:25.540557 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:25.540452 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:27.611775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:27.611736 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:27.676589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:27.676560 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:32.843463 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:32.843426 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:32.904652 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:32.904605 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:33.508805 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:33.508773 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:33.568769 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:33.568744 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:37.295540 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:37.295498 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:37.354422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:37.354394 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:44.835215 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:44.835182 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:44.944223 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:44.944189 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:45.000876 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:45.000849 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:47.861063 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:47.861029 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:27:47.959055 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:27:47.959027 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:07.601272 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:07.601240 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:07.700461 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:07.700430 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:08.425024 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.424987 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr"] Sep 10 17:28:08.425342 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.425324 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d4dd53-7a37-4d48-9533-04b90e1fba86" containerName="console" Sep 10 17:28:08.425419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.425345 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d4dd53-7a37-4d48-9533-04b90e1fba86" containerName="console" Sep 10 17:28:08.425475 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.425421 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d4dd53-7a37-4d48-9533-04b90e1fba86" containerName="console" Sep 10 17:28:08.427919 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.427893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.430139 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.430119 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:28:08.430242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.430176 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:28:08.430834 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.430818 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z4mth\"" Sep 10 17:28:08.435790 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.435771 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr"] Sep 10 17:28:08.500476 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.500450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.500625 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.500485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89zxh\" (UniqueName: \"kubernetes.io/projected/fe024156-c829-46b2-8a30-20a2f6bdb896-kube-api-access-89zxh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.500625 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.500615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.601972 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.601950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.602269 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.602000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.602269 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.602019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89zxh\" (UniqueName: \"kubernetes.io/projected/fe024156-c829-46b2-8a30-20a2f6bdb896-kube-api-access-89zxh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.602357 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.602335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.602357 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.602349 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.610596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.610568 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89zxh\" (UniqueName: \"kubernetes.io/projected/fe024156-c829-46b2-8a30-20a2f6bdb896-kube-api-access-89zxh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:08.738466 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:08.738443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:09.004020 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:09.003942 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr"] Sep 10 17:28:09.430192 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:09.430111 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" event={"ID":"fe024156-c829-46b2-8a30-20a2f6bdb896","Type":"ContainerStarted","Data":"7c9359bbaa3614d905a88858bc82335708c255a50354c555ad196e24161a6963"} Sep 10 17:28:17.463625 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:17.463583 2580 generic.go:356] "Generic (PLEG): container finished" podID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerID="269f1ebcd5840480cad55ab17aa2030d3b3f457c969cdca99a0249c667670f4d" exitCode=0 Sep 10 17:28:17.464066 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:17.463671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" event={"ID":"fe024156-c829-46b2-8a30-20a2f6bdb896","Type":"ContainerDied","Data":"269f1ebcd5840480cad55ab17aa2030d3b3f457c969cdca99a0249c667670f4d"} Sep 10 17:28:20.477304 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:20.477265 2580 generic.go:356] "Generic (PLEG): container finished" podID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerID="6f9ebbd73fd98eb7b2daff846720dc83caba83692cd03888203c0f0df24fb757" exitCode=0 Sep 10 17:28:20.477733 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:20.477349 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" event={"ID":"fe024156-c829-46b2-8a30-20a2f6bdb896","Type":"ContainerDied","Data":"6f9ebbd73fd98eb7b2daff846720dc83caba83692cd03888203c0f0df24fb757"} Sep 10 17:28:23.289033 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:23.288998 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:28.511954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:28.511924 2580 generic.go:356] "Generic (PLEG): container finished" podID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerID="05f0861b44f4385d77af2929f7d9cf915b3b2da68427ae5b48b91bc4b4ada8ad" exitCode=0 Sep 10 17:28:28.512329 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:28.511981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" event={"ID":"fe024156-c829-46b2-8a30-20a2f6bdb896","Type":"ContainerDied","Data":"05f0861b44f4385d77af2929f7d9cf915b3b2da68427ae5b48b91bc4b4ada8ad"} Sep 10 17:28:29.638749 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.638725 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:29.769668 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.769556 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-util\") pod \"fe024156-c829-46b2-8a30-20a2f6bdb896\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " Sep 10 17:28:29.769668 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.769652 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89zxh\" (UniqueName: \"kubernetes.io/projected/fe024156-c829-46b2-8a30-20a2f6bdb896-kube-api-access-89zxh\") pod \"fe024156-c829-46b2-8a30-20a2f6bdb896\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " Sep 10 17:28:29.769911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.769683 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-bundle\") pod \"fe024156-c829-46b2-8a30-20a2f6bdb896\" (UID: \"fe024156-c829-46b2-8a30-20a2f6bdb896\") " Sep 10 17:28:29.770359 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.770336 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-bundle" (OuterVolumeSpecName: "bundle") pod "fe024156-c829-46b2-8a30-20a2f6bdb896" (UID: "fe024156-c829-46b2-8a30-20a2f6bdb896"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:28:29.772002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.771973 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe024156-c829-46b2-8a30-20a2f6bdb896-kube-api-access-89zxh" (OuterVolumeSpecName: "kube-api-access-89zxh") pod "fe024156-c829-46b2-8a30-20a2f6bdb896" (UID: "fe024156-c829-46b2-8a30-20a2f6bdb896"). InnerVolumeSpecName "kube-api-access-89zxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:28:29.774006 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.773984 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-util" (OuterVolumeSpecName: "util") pod "fe024156-c829-46b2-8a30-20a2f6bdb896" (UID: "fe024156-c829-46b2-8a30-20a2f6bdb896"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:28:29.870612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.870575 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89zxh\" (UniqueName: \"kubernetes.io/projected/fe024156-c829-46b2-8a30-20a2f6bdb896-kube-api-access-89zxh\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:28:29.870612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.870608 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:28:29.870829 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:29.870620 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe024156-c829-46b2-8a30-20a2f6bdb896-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:28:30.521041 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:30.521009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" event={"ID":"fe024156-c829-46b2-8a30-20a2f6bdb896","Type":"ContainerDied","Data":"7c9359bbaa3614d905a88858bc82335708c255a50354c555ad196e24161a6963"} Sep 10 17:28:30.521171 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:30.521053 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c9359bbaa3614d905a88858bc82335708c255a50354c555ad196e24161a6963" Sep 10 17:28:30.521171 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:30.521056 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402jsgr" Sep 10 17:28:34.716344 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:34.716307 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:36.146106 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.146069 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:36.613191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613162 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9"] Sep 10 17:28:36.613457 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613443 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerName="util" Sep 10 17:28:36.613506 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613459 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerName="util" Sep 10 17:28:36.613506 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613477 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerName="pull" Sep 10 17:28:36.613506 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613482 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerName="pull" Sep 10 17:28:36.613506 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613488 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerName="extract" Sep 10 17:28:36.613506 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613493 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerName="extract" Sep 10 17:28:36.613688 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.613538 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe024156-c829-46b2-8a30-20a2f6bdb896" containerName="extract" Sep 10 17:28:36.616919 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.616905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:36.619352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.619336 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 17:28:36.619916 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.619899 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:28:36.621782 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.621765 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-strdz\"" Sep 10 17:28:36.632355 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.632333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9"] Sep 10 17:28:36.717728 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.717701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b8710e2-15e5-4af1-a2cb-0ca039c045a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kkgs9\" (UID: \"7b8710e2-15e5-4af1-a2cb-0ca039c045a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:36.717830 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.717731 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8th5j\" (UniqueName: \"kubernetes.io/projected/7b8710e2-15e5-4af1-a2cb-0ca039c045a2-kube-api-access-8th5j\") pod \"cert-manager-operator-controller-manager-55c444bf86-kkgs9\" (UID: \"7b8710e2-15e5-4af1-a2cb-0ca039c045a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:36.818735 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.818710 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b8710e2-15e5-4af1-a2cb-0ca039c045a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kkgs9\" (UID: \"7b8710e2-15e5-4af1-a2cb-0ca039c045a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:36.818850 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.818742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8th5j\" (UniqueName: \"kubernetes.io/projected/7b8710e2-15e5-4af1-a2cb-0ca039c045a2-kube-api-access-8th5j\") pod \"cert-manager-operator-controller-manager-55c444bf86-kkgs9\" (UID: \"7b8710e2-15e5-4af1-a2cb-0ca039c045a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:36.819071 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.819053 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b8710e2-15e5-4af1-a2cb-0ca039c045a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kkgs9\" (UID: \"7b8710e2-15e5-4af1-a2cb-0ca039c045a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:36.828571 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.828549 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8th5j\" (UniqueName: \"kubernetes.io/projected/7b8710e2-15e5-4af1-a2cb-0ca039c045a2-kube-api-access-8th5j\") pod \"cert-manager-operator-controller-manager-55c444bf86-kkgs9\" (UID: \"7b8710e2-15e5-4af1-a2cb-0ca039c045a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:36.926204 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:36.926149 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" Sep 10 17:28:37.200342 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:37.200311 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9"] Sep 10 17:28:37.203536 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:28:37.203508 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8710e2_15e5_4af1_a2cb_0ca039c045a2.slice/crio-34dfd71fbfcc6676adaa5c58b1ff52279c8b2dec05e30e6bbae197ef1a5dd1a5 WatchSource:0}: Error finding container 34dfd71fbfcc6676adaa5c58b1ff52279c8b2dec05e30e6bbae197ef1a5dd1a5: Status 404 returned error can't find the container with id 34dfd71fbfcc6676adaa5c58b1ff52279c8b2dec05e30e6bbae197ef1a5dd1a5 Sep 10 17:28:37.547145 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:37.547085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" event={"ID":"7b8710e2-15e5-4af1-a2cb-0ca039c045a2","Type":"ContainerStarted","Data":"34dfd71fbfcc6676adaa5c58b1ff52279c8b2dec05e30e6bbae197ef1a5dd1a5"} Sep 10 17:28:38.428227 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:38.428171 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:38.527390 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:38.527355 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:39.557333 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:39.557296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" event={"ID":"7b8710e2-15e5-4af1-a2cb-0ca039c045a2","Type":"ContainerStarted","Data":"5560246e5df643011c0a034a97c820822825831fe3866eb1945295d97671c630"} Sep 10 17:28:39.576993 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:39.576938 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kkgs9" podStartSLOduration=1.819311394 podStartE2EDuration="3.576918543s" totalImagesPullingTime="1.757607149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:28:39.575515509 +0000 UTC m=+286.595442662" watchObservedRunningTime="2026-09-10 17:28:39.576918543 +0000 UTC m=+286.596845697" Sep 10 17:28:39.789333 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:39.789297 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:39.901665 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:39.901570 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:40.004251 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:40.004226 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:41.336497 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.336461 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5"] Sep 10 17:28:41.338906 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.338886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.341145 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.341120 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:28:41.341410 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.341391 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z4mth\"" Sep 10 17:28:41.341814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.341799 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:28:41.356064 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.356042 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5"] Sep 10 17:28:41.452305 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.452281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.452400 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.452320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mhdj\" (UniqueName: \"kubernetes.io/projected/646ed994-1c6b-4cb2-86cb-3fd71107dd10-kube-api-access-9mhdj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.452448 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.452397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.552920 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.552895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.553017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.552934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mhdj\" (UniqueName: \"kubernetes.io/projected/646ed994-1c6b-4cb2-86cb-3fd71107dd10-kube-api-access-9mhdj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.553017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.552978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.553292 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.553271 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.553405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.553297 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.566533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.566507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mhdj\" (UniqueName: \"kubernetes.io/projected/646ed994-1c6b-4cb2-86cb-3fd71107dd10-kube-api-access-9mhdj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.647364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.647311 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:41.918889 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.918865 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5"] Sep 10 17:28:41.921512 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:28:41.921486 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646ed994_1c6b_4cb2_86cb_3fd71107dd10.slice/crio-4abac63e637c7d1b0c1172486ac462eba1fafde13a869edf27379dc7786a9be3 WatchSource:0}: Error finding container 4abac63e637c7d1b0c1172486ac462eba1fafde13a869edf27379dc7786a9be3: Status 404 returned error can't find the container with id 4abac63e637c7d1b0c1172486ac462eba1fafde13a869edf27379dc7786a9be3 Sep 10 17:28:41.987779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:41.987755 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:42.395238 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:42.395209 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:42.570709 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:42.570682 2580 generic.go:356] "Generic (PLEG): container finished" podID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerID="00b4dc67a7b8126eef76543f18b41d3ac4f9b0de348aa4bedcfe5ebe24ef2dd0" exitCode=0 Sep 10 17:28:42.570844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:42.570761 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" event={"ID":"646ed994-1c6b-4cb2-86cb-3fd71107dd10","Type":"ContainerDied","Data":"00b4dc67a7b8126eef76543f18b41d3ac4f9b0de348aa4bedcfe5ebe24ef2dd0"} Sep 10 17:28:42.570844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:42.570806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" event={"ID":"646ed994-1c6b-4cb2-86cb-3fd71107dd10","Type":"ContainerStarted","Data":"4abac63e637c7d1b0c1172486ac462eba1fafde13a869edf27379dc7786a9be3"} Sep 10 17:28:45.118981 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:45.118947 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:45.183459 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:45.183423 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:45.586421 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:45.586393 2580 generic.go:356] "Generic (PLEG): container finished" podID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerID="efa496b939d5d4fbcddc548bcf8bf8ce57c0dd358d219afc500f2c5d8d1d7bf3" exitCode=0 Sep 10 17:28:45.586565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:45.586435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" event={"ID":"646ed994-1c6b-4cb2-86cb-3fd71107dd10","Type":"ContainerDied","Data":"efa496b939d5d4fbcddc548bcf8bf8ce57c0dd358d219afc500f2c5d8d1d7bf3"} Sep 10 17:28:46.592591 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:46.592561 2580 generic.go:356] "Generic (PLEG): container finished" podID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerID="03fd7bdc70f79b259b49a36b0c8a1c3edc2d7628822505037884ff4cbdb6378e" exitCode=0 Sep 10 17:28:46.592988 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:46.592664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" event={"ID":"646ed994-1c6b-4cb2-86cb-3fd71107dd10","Type":"ContainerDied","Data":"03fd7bdc70f79b259b49a36b0c8a1c3edc2d7628822505037884ff4cbdb6378e"} Sep 10 17:28:47.317838 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.317801 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:47.416243 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.416219 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:47.720653 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.720620 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:47.800699 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.800673 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-util\") pod \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " Sep 10 17:28:47.800812 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.800712 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mhdj\" (UniqueName: \"kubernetes.io/projected/646ed994-1c6b-4cb2-86cb-3fd71107dd10-kube-api-access-9mhdj\") pod \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " Sep 10 17:28:47.800812 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.800797 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-bundle\") pod \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\" (UID: \"646ed994-1c6b-4cb2-86cb-3fd71107dd10\") " Sep 10 17:28:47.801824 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.801792 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-bundle" (OuterVolumeSpecName: "bundle") pod "646ed994-1c6b-4cb2-86cb-3fd71107dd10" (UID: "646ed994-1c6b-4cb2-86cb-3fd71107dd10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:28:47.807620 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.807592 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/646ed994-1c6b-4cb2-86cb-3fd71107dd10-kube-api-access-9mhdj" (OuterVolumeSpecName: "kube-api-access-9mhdj") pod "646ed994-1c6b-4cb2-86cb-3fd71107dd10" (UID: "646ed994-1c6b-4cb2-86cb-3fd71107dd10"). InnerVolumeSpecName "kube-api-access-9mhdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:28:47.808537 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.808444 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-util" (OuterVolumeSpecName: "util") pod "646ed994-1c6b-4cb2-86cb-3fd71107dd10" (UID: "646ed994-1c6b-4cb2-86cb-3fd71107dd10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:28:47.902760 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.902693 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:28:47.902760 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.902717 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mhdj\" (UniqueName: \"kubernetes.io/projected/646ed994-1c6b-4cb2-86cb-3fd71107dd10-kube-api-access-9mhdj\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:28:47.902760 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:47.902728 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/646ed994-1c6b-4cb2-86cb-3fd71107dd10-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:28:48.602199 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:48.602161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" event={"ID":"646ed994-1c6b-4cb2-86cb-3fd71107dd10","Type":"ContainerDied","Data":"4abac63e637c7d1b0c1172486ac462eba1fafde13a869edf27379dc7786a9be3"} Sep 10 17:28:48.602364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:48.602218 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4abac63e637c7d1b0c1172486ac462eba1fafde13a869edf27379dc7786a9be3" Sep 10 17:28:48.602364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:48.602180 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4rnp5" Sep 10 17:28:50.572959 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:50.572917 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:52.877595 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.877557 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pd86l"] Sep 10 17:28:52.878053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.877972 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerName="extract" Sep 10 17:28:52.878053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.877990 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerName="extract" Sep 10 17:28:52.878053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.878005 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerName="pull" Sep 10 17:28:52.878053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.878013 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerName="pull" Sep 10 17:28:52.878053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.878041 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerName="util" Sep 10 17:28:52.878053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.878048 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerName="util" Sep 10 17:28:52.878317 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.878112 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="646ed994-1c6b-4cb2-86cb-3fd71107dd10" containerName="extract" Sep 10 17:28:52.881453 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.881432 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:52.883755 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.883728 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 17:28:52.883855 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.883728 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lkmwf\"" Sep 10 17:28:52.883855 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.883782 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 17:28:52.891251 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:52.891226 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pd86l"] Sep 10 17:28:53.039717 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.039691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b1208d5-4d3e-4b00-b494-c8fe43814b48-bound-sa-token\") pod \"cert-manager-55b4d954d5-pd86l\" (UID: \"2b1208d5-4d3e-4b00-b494-c8fe43814b48\") " pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:53.039859 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.039755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9hdw\" (UniqueName: \"kubernetes.io/projected/2b1208d5-4d3e-4b00-b494-c8fe43814b48-kube-api-access-z9hdw\") pod \"cert-manager-55b4d954d5-pd86l\" (UID: \"2b1208d5-4d3e-4b00-b494-c8fe43814b48\") " pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:53.140240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.140186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b1208d5-4d3e-4b00-b494-c8fe43814b48-bound-sa-token\") pod \"cert-manager-55b4d954d5-pd86l\" (UID: \"2b1208d5-4d3e-4b00-b494-c8fe43814b48\") " pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:53.140240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.140236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9hdw\" (UniqueName: \"kubernetes.io/projected/2b1208d5-4d3e-4b00-b494-c8fe43814b48-kube-api-access-z9hdw\") pod \"cert-manager-55b4d954d5-pd86l\" (UID: \"2b1208d5-4d3e-4b00-b494-c8fe43814b48\") " pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:53.148807 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.148783 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b1208d5-4d3e-4b00-b494-c8fe43814b48-bound-sa-token\") pod \"cert-manager-55b4d954d5-pd86l\" (UID: \"2b1208d5-4d3e-4b00-b494-c8fe43814b48\") " pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:53.148957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.148937 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9hdw\" (UniqueName: \"kubernetes.io/projected/2b1208d5-4d3e-4b00-b494-c8fe43814b48-kube-api-access-z9hdw\") pod \"cert-manager-55b4d954d5-pd86l\" (UID: \"2b1208d5-4d3e-4b00-b494-c8fe43814b48\") " pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:53.190365 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.190344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pd86l" Sep 10 17:28:53.352666 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.352626 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 17:28:53.470382 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.457858 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pd86l"] Sep 10 17:28:53.470382 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:28:53.460397 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b1208d5_4d3e_4b00_b494_c8fe43814b48.slice/crio-48c5af90d3eeeaf1f6840807bc908cf7a34d416f43bc86f1566ae56ee5e07a00 WatchSource:0}: Error finding container 48c5af90d3eeeaf1f6840807bc908cf7a34d416f43bc86f1566ae56ee5e07a00: Status 404 returned error can't find the container with id 48c5af90d3eeeaf1f6840807bc908cf7a34d416f43bc86f1566ae56ee5e07a00 Sep 10 17:28:53.623536 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:53.623509 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pd86l" event={"ID":"2b1208d5-4d3e-4b00-b494-c8fe43814b48","Type":"ContainerStarted","Data":"48c5af90d3eeeaf1f6840807bc908cf7a34d416f43bc86f1566ae56ee5e07a00"} Sep 10 17:28:56.521863 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:56.521825 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:56.619157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:56.619122 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:28:56.638064 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:56.638038 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pd86l" event={"ID":"2b1208d5-4d3e-4b00-b494-c8fe43814b48","Type":"ContainerStarted","Data":"7d89aee4ed82ecdda651d35469014382403231a0f78a5835881b7f774f2ce85a"} Sep 10 17:28:56.658929 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:28:56.655995 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pd86l" podStartSLOduration=2.176681719 podStartE2EDuration="4.65597479s" totalImagesPullingTime="2.479293071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:28:56.652790693 +0000 UTC m=+303.672717846" watchObservedRunningTime="2026-09-10 17:28:56.65597479 +0000 UTC m=+303.675901951" Sep 10 17:29:02.677183 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:02.677153 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:02.781534 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:02.781502 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:04.524172 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:04.524140 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:06.323901 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.323857 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph"] Sep 10 17:29:06.326329 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.326312 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.328686 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.328657 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z4mth\"" Sep 10 17:29:06.328686 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.328666 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:29:06.328834 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.328698 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:29:06.335685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.335663 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph"] Sep 10 17:29:06.438241 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.438207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.438364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.438248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.438364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.438280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-787px\" (UniqueName: \"kubernetes.io/projected/73da2cee-8691-43ca-bae9-a99a0ddcc830-kube-api-access-787px\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.539499 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.539466 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.539621 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.539516 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-787px\" (UniqueName: \"kubernetes.io/projected/73da2cee-8691-43ca-bae9-a99a0ddcc830-kube-api-access-787px\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.539621 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.539555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.539870 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.539852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.539939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.539871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.548717 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.548697 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-787px\" (UniqueName: \"kubernetes.io/projected/73da2cee-8691-43ca-bae9-a99a0ddcc830-kube-api-access-787px\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.634824 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.634776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:06.907674 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:06.907582 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph"] Sep 10 17:29:06.911623 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:29:06.911592 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73da2cee_8691_43ca_bae9_a99a0ddcc830.slice/crio-29effedcdbc477b488b12803335e6856f9eb5d0649a4a448ae5d649e20b5d405 WatchSource:0}: Error finding container 29effedcdbc477b488b12803335e6856f9eb5d0649a4a448ae5d649e20b5d405: Status 404 returned error can't find the container with id 29effedcdbc477b488b12803335e6856f9eb5d0649a4a448ae5d649e20b5d405 Sep 10 17:29:07.686113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:07.686077 2580 generic.go:356] "Generic (PLEG): container finished" podID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerID="49c010ebf4f806bcec80eb793b8f181dca37e876ac80a11a4335acb822dfe3f5" exitCode=0 Sep 10 17:29:07.686463 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:07.686167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" event={"ID":"73da2cee-8691-43ca-bae9-a99a0ddcc830","Type":"ContainerDied","Data":"49c010ebf4f806bcec80eb793b8f181dca37e876ac80a11a4335acb822dfe3f5"} Sep 10 17:29:07.686463 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:07.686224 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" event={"ID":"73da2cee-8691-43ca-bae9-a99a0ddcc830","Type":"ContainerStarted","Data":"29effedcdbc477b488b12803335e6856f9eb5d0649a4a448ae5d649e20b5d405"} Sep 10 17:29:07.686677 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:07.686662 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:29:08.691687 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:08.691603 2580 generic.go:356] "Generic (PLEG): container finished" podID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerID="059b842aa01401717405019b75c19b147f956c570c388f7adf042882d81e55fa" exitCode=0 Sep 10 17:29:08.692019 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:08.691693 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" event={"ID":"73da2cee-8691-43ca-bae9-a99a0ddcc830","Type":"ContainerDied","Data":"059b842aa01401717405019b75c19b147f956c570c388f7adf042882d81e55fa"} Sep 10 17:29:09.698278 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:09.698229 2580 generic.go:356] "Generic (PLEG): container finished" podID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerID="012d3309dd6069e08f1c397918efcfdce7f01ed3947b55a697686df07bd9026f" exitCode=0 Sep 10 17:29:09.698689 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:09.698288 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" event={"ID":"73da2cee-8691-43ca-bae9-a99a0ddcc830","Type":"ContainerDied","Data":"012d3309dd6069e08f1c397918efcfdce7f01ed3947b55a697686df07bd9026f"} Sep 10 17:29:10.821083 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:10.821061 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:10.971242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:10.971179 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-util\") pod \"73da2cee-8691-43ca-bae9-a99a0ddcc830\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " Sep 10 17:29:10.971242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:10.971231 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-787px\" (UniqueName: \"kubernetes.io/projected/73da2cee-8691-43ca-bae9-a99a0ddcc830-kube-api-access-787px\") pod \"73da2cee-8691-43ca-bae9-a99a0ddcc830\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " Sep 10 17:29:10.971440 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:10.971269 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-bundle\") pod \"73da2cee-8691-43ca-bae9-a99a0ddcc830\" (UID: \"73da2cee-8691-43ca-bae9-a99a0ddcc830\") " Sep 10 17:29:10.972180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:10.972153 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-bundle" (OuterVolumeSpecName: "bundle") pod "73da2cee-8691-43ca-bae9-a99a0ddcc830" (UID: "73da2cee-8691-43ca-bae9-a99a0ddcc830"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:29:10.973408 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:10.973386 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73da2cee-8691-43ca-bae9-a99a0ddcc830-kube-api-access-787px" (OuterVolumeSpecName: "kube-api-access-787px") pod "73da2cee-8691-43ca-bae9-a99a0ddcc830" (UID: "73da2cee-8691-43ca-bae9-a99a0ddcc830"). InnerVolumeSpecName "kube-api-access-787px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:29:10.979633 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:10.979586 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-util" (OuterVolumeSpecName: "util") pod "73da2cee-8691-43ca-bae9-a99a0ddcc830" (UID: "73da2cee-8691-43ca-bae9-a99a0ddcc830"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:29:11.072654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:11.072615 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:29:11.072654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:11.072650 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73da2cee-8691-43ca-bae9-a99a0ddcc830-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:29:11.072772 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:11.072664 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-787px\" (UniqueName: \"kubernetes.io/projected/73da2cee-8691-43ca-bae9-a99a0ddcc830-kube-api-access-787px\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:29:11.708572 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:11.708545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" event={"ID":"73da2cee-8691-43ca-bae9-a99a0ddcc830","Type":"ContainerDied","Data":"29effedcdbc477b488b12803335e6856f9eb5d0649a4a448ae5d649e20b5d405"} Sep 10 17:29:11.708709 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:11.708589 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29effedcdbc477b488b12803335e6856f9eb5d0649a4a448ae5d649e20b5d405" Sep 10 17:29:11.708709 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:11.708595 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7brph" Sep 10 17:29:15.747730 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.747692 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr"] Sep 10 17:29:15.748191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.748081 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerName="util" Sep 10 17:29:15.748191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.748098 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerName="util" Sep 10 17:29:15.748191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.748116 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerName="extract" Sep 10 17:29:15.748191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.748124 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerName="extract" Sep 10 17:29:15.748191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.748146 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerName="pull" Sep 10 17:29:15.748191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.748153 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerName="pull" Sep 10 17:29:15.748489 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.748255 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="73da2cee-8691-43ca-bae9-a99a0ddcc830" containerName="extract" Sep 10 17:29:15.750276 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.750256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:15.752595 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.752572 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:29:15.752714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.752576 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:29:15.753136 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.753122 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z4mth\"" Sep 10 17:29:15.760029 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.760010 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr"] Sep 10 17:29:15.905147 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.905122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:15.905242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.905154 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95qv8\" (UniqueName: \"kubernetes.io/projected/af0ea8cd-7f97-46ba-9a07-7d622619813d-kube-api-access-95qv8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:15.905242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:15.905227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.006431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.006372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.006431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.006414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.006431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.006432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95qv8\" (UniqueName: \"kubernetes.io/projected/af0ea8cd-7f97-46ba-9a07-7d622619813d-kube-api-access-95qv8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.006818 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.006799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.006885 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.006833 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.015245 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.015221 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95qv8\" (UniqueName: \"kubernetes.io/projected/af0ea8cd-7f97-46ba-9a07-7d622619813d-kube-api-access-95qv8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.059022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.059004 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:16.330425 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.330354 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr"] Sep 10 17:29:16.333738 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:29:16.333712 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0ea8cd_7f97_46ba_9a07_7d622619813d.slice/crio-8120b0a056062047b3247d1d8591fb3db6c71a3802bfc3a7f472b45e386e12de WatchSource:0}: Error finding container 8120b0a056062047b3247d1d8591fb3db6c71a3802bfc3a7f472b45e386e12de: Status 404 returned error can't find the container with id 8120b0a056062047b3247d1d8591fb3db6c71a3802bfc3a7f472b45e386e12de Sep 10 17:29:16.735913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.735881 2580 generic.go:356] "Generic (PLEG): container finished" podID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerID="24c515ab6d7665df521e2234bd5553d759e1f0af817ccc48fe60d11d65bf190d" exitCode=0 Sep 10 17:29:16.736053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.735918 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" event={"ID":"af0ea8cd-7f97-46ba-9a07-7d622619813d","Type":"ContainerDied","Data":"24c515ab6d7665df521e2234bd5553d759e1f0af817ccc48fe60d11d65bf190d"} Sep 10 17:29:16.736053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:16.735951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" event={"ID":"af0ea8cd-7f97-46ba-9a07-7d622619813d","Type":"ContainerStarted","Data":"8120b0a056062047b3247d1d8591fb3db6c71a3802bfc3a7f472b45e386e12de"} Sep 10 17:29:17.069437 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:17.069406 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:17.185818 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:17.185787 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:17.655951 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:17.655884 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:17.742186 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:17.742160 2580 generic.go:356] "Generic (PLEG): container finished" podID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerID="f4dbca79b693c6b2f630294a9d598cb3cceea3cdda395c88ebd34153daa5f0fc" exitCode=0 Sep 10 17:29:17.742334 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:17.742247 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" event={"ID":"af0ea8cd-7f97-46ba-9a07-7d622619813d","Type":"ContainerDied","Data":"f4dbca79b693c6b2f630294a9d598cb3cceea3cdda395c88ebd34153daa5f0fc"} Sep 10 17:29:17.932253 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:17.932193 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:18.036436 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.036411 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:18.126164 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.126140 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl"] Sep 10 17:29:18.128330 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.128315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.131708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.131690 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 17:29:18.131847 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.131824 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 17:29:18.131959 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.131880 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hzpgd\"" Sep 10 17:29:18.132075 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.132058 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 17:29:18.132145 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.132131 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 17:29:18.151205 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.151179 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl"] Sep 10 17:29:18.223416 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.223391 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7fcd749-5bab-42ea-8200-49868691d0bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.223512 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.223421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7fcd749-5bab-42ea-8200-49868691d0bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.223512 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.223462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fcd749-5bab-42ea-8200-49868691d0bb-tmp\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.223575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.223527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tchjk\" (UniqueName: \"kubernetes.io/projected/d7fcd749-5bab-42ea-8200-49868691d0bb-kube-api-access-tchjk\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.223614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.223597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7fcd749-5bab-42ea-8200-49868691d0bb-manifests\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.311947 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.311917 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:18.324800 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.324778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7fcd749-5bab-42ea-8200-49868691d0bb-manifests\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.324897 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.324816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7fcd749-5bab-42ea-8200-49868691d0bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.324897 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.324834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7fcd749-5bab-42ea-8200-49868691d0bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.325009 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.324955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fcd749-5bab-42ea-8200-49868691d0bb-tmp\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.325009 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.324992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tchjk\" (UniqueName: \"kubernetes.io/projected/d7fcd749-5bab-42ea-8200-49868691d0bb-kube-api-access-tchjk\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.325219 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.325200 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7fcd749-5bab-42ea-8200-49868691d0bb-manifests\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.327330 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.327304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fcd749-5bab-42ea-8200-49868691d0bb-tmp\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.327536 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.327518 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7fcd749-5bab-42ea-8200-49868691d0bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.327603 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.327568 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7fcd749-5bab-42ea-8200-49868691d0bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.335427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.335404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tchjk\" (UniqueName: \"kubernetes.io/projected/d7fcd749-5bab-42ea-8200-49868691d0bb-kube-api-access-tchjk\") pod \"opendatahub-operator-controller-manager-b6bb7766-62ljl\" (UID: \"d7fcd749-5bab-42ea-8200-49868691d0bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.414033 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.413999 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:18.438366 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.438344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:18.514713 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.514678 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:18.617724 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.617697 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:18.718970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.718940 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl"] Sep 10 17:29:18.720088 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.719992 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:18.722899 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:29:18.722875 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fcd749_5bab_42ea_8200_49868691d0bb.slice/crio-f839a0e556f3abcea1bbaa1c424e849456fb5c3db2a64a97a5144274fe90467a WatchSource:0}: Error finding container f839a0e556f3abcea1bbaa1c424e849456fb5c3db2a64a97a5144274fe90467a: Status 404 returned error can't find the container with id f839a0e556f3abcea1bbaa1c424e849456fb5c3db2a64a97a5144274fe90467a Sep 10 17:29:18.748402 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.748340 2580 generic.go:356] "Generic (PLEG): container finished" podID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerID="4292dd7ac105bbc4e279b8d44f18ad933c39016bffc1e30890dde58268d859ec" exitCode=0 Sep 10 17:29:18.748499 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.748423 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" event={"ID":"af0ea8cd-7f97-46ba-9a07-7d622619813d","Type":"ContainerDied","Data":"4292dd7ac105bbc4e279b8d44f18ad933c39016bffc1e30890dde58268d859ec"} Sep 10 17:29:18.749680 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:18.749660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" event={"ID":"d7fcd749-5bab-42ea-8200-49868691d0bb","Type":"ContainerStarted","Data":"f839a0e556f3abcea1bbaa1c424e849456fb5c3db2a64a97a5144274fe90467a"} Sep 10 17:29:19.909390 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:19.909364 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:20.040373 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.040289 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95qv8\" (UniqueName: \"kubernetes.io/projected/af0ea8cd-7f97-46ba-9a07-7d622619813d-kube-api-access-95qv8\") pod \"af0ea8cd-7f97-46ba-9a07-7d622619813d\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " Sep 10 17:29:20.040373 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.040347 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-bundle\") pod \"af0ea8cd-7f97-46ba-9a07-7d622619813d\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " Sep 10 17:29:20.040629 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.040461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-util\") pod \"af0ea8cd-7f97-46ba-9a07-7d622619813d\" (UID: \"af0ea8cd-7f97-46ba-9a07-7d622619813d\") " Sep 10 17:29:20.041211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.041187 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-bundle" (OuterVolumeSpecName: "bundle") pod "af0ea8cd-7f97-46ba-9a07-7d622619813d" (UID: "af0ea8cd-7f97-46ba-9a07-7d622619813d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:29:20.043090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.043052 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0ea8cd-7f97-46ba-9a07-7d622619813d-kube-api-access-95qv8" (OuterVolumeSpecName: "kube-api-access-95qv8") pod "af0ea8cd-7f97-46ba-9a07-7d622619813d" (UID: "af0ea8cd-7f97-46ba-9a07-7d622619813d"). InnerVolumeSpecName "kube-api-access-95qv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:29:20.047228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.047183 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-util" (OuterVolumeSpecName: "util") pod "af0ea8cd-7f97-46ba-9a07-7d622619813d" (UID: "af0ea8cd-7f97-46ba-9a07-7d622619813d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:29:20.141978 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.141954 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95qv8\" (UniqueName: \"kubernetes.io/projected/af0ea8cd-7f97-46ba-9a07-7d622619813d-kube-api-access-95qv8\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:29:20.142105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.141982 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:29:20.142105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.141996 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af0ea8cd-7f97-46ba-9a07-7d622619813d-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:29:20.760774 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.760742 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" Sep 10 17:29:20.760774 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.760751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qw5kr" event={"ID":"af0ea8cd-7f97-46ba-9a07-7d622619813d","Type":"ContainerDied","Data":"8120b0a056062047b3247d1d8591fb3db6c71a3802bfc3a7f472b45e386e12de"} Sep 10 17:29:20.761000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:20.760800 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8120b0a056062047b3247d1d8591fb3db6c71a3802bfc3a7f472b45e386e12de" Sep 10 17:29:22.772831 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:22.772797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" event={"ID":"d7fcd749-5bab-42ea-8200-49868691d0bb","Type":"ContainerStarted","Data":"36ec836452ba61a7244c8485d5cce82ab8db3ed89ce674e79c7505a622f036b3"} Sep 10 17:29:23.467684 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:23.467580 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:23.778766 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:23.778683 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7fcd749-5bab-42ea-8200-49868691d0bb" containerID="36ec836452ba61a7244c8485d5cce82ab8db3ed89ce674e79c7505a622f036b3" exitCode=0 Sep 10 17:29:23.779134 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:23.778775 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" event={"ID":"d7fcd749-5bab-42ea-8200-49868691d0bb","Type":"ContainerDied","Data":"36ec836452ba61a7244c8485d5cce82ab8db3ed89ce674e79c7505a622f036b3"} Sep 10 17:29:24.785854 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:24.785818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" event={"ID":"d7fcd749-5bab-42ea-8200-49868691d0bb","Type":"ContainerStarted","Data":"6978b48a94d956f29cab3242fbdb2bec2f9511c91f4a29e3f66a289584ac8809"} Sep 10 17:29:24.786228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:24.785960 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:24.810802 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:24.810757 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" podStartSLOduration=2.245653754 podStartE2EDuration="6.810743356s" totalImagesPullingTime="3.530149065s" totalInitContainerRuntime="1.034940537s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:29:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:29:24.809357436 +0000 UTC m=+331.829284588" watchObservedRunningTime="2026-09-10 17:29:24.810743356 +0000 UTC m=+331.830670508" Sep 10 17:29:28.472960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:28.472924 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:28.590378 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:28.590348 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:30.859716 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:30.859624 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:30.955419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:30.955393 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:35.793370 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:35.793341 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b6bb7766-62ljl" Sep 10 17:29:37.174210 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174179 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl"] Sep 10 17:29:37.174618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174462 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerName="extract" Sep 10 17:29:37.174618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174473 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerName="extract" Sep 10 17:29:37.174618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174489 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerName="util" Sep 10 17:29:37.174618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174494 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerName="util" Sep 10 17:29:37.174618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174500 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerName="pull" Sep 10 17:29:37.174618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174506 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerName="pull" Sep 10 17:29:37.174618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.174560 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0ea8cd-7f97-46ba-9a07-7d622619813d" containerName="extract" Sep 10 17:29:37.181347 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.181326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.183676 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.183632 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 17:29:37.184448 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.184427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 17:29:37.184548 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.184483 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 17:29:37.184548 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.184483 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:29:37.184656 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.184488 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 17:29:37.184656 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.184489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8hs6s\"" Sep 10 17:29:37.203002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.202980 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl"] Sep 10 17:29:37.274221 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.274196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqws\" (UniqueName: \"kubernetes.io/projected/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-kube-api-access-skqws\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.274345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.274240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-cert\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.274345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.274280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-metrics-cert\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.274345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.274323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-manager-config\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.374866 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.374836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-manager-config\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.374977 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.374911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skqws\" (UniqueName: \"kubernetes.io/projected/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-kube-api-access-skqws\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.375070 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.375051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-cert\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.375188 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.375154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-metrics-cert\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.375671 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.375631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-manager-config\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.377853 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.377827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-cert\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.377853 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.377843 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-metrics-cert\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.394915 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.394881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqws\" (UniqueName: \"kubernetes.io/projected/ff8e73a5-7be4-4b3c-bf93-c885b89ec452-kube-api-access-skqws\") pod \"lws-controller-manager-86c5cb66bd-jd4vl\" (UID: \"ff8e73a5-7be4-4b3c-bf93-c885b89ec452\") " pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.440322 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.440212 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:37.490347 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.490325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:37.668910 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.668881 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:37.777586 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.777561 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl"] Sep 10 17:29:37.780699 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:29:37.780673 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8e73a5_7be4_4b3c_bf93_c885b89ec452.slice/crio-89ea3131312ff426dd4f4704c01bc9dcbbb6ef1d4816b6c29d525b8930764b5e WatchSource:0}: Error finding container 89ea3131312ff426dd4f4704c01bc9dcbbb6ef1d4816b6c29d525b8930764b5e: Status 404 returned error can't find the container with id 89ea3131312ff426dd4f4704c01bc9dcbbb6ef1d4816b6c29d525b8930764b5e Sep 10 17:29:37.844860 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.844829 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:37.847241 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:37.847218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" event={"ID":"ff8e73a5-7be4-4b3c-bf93-c885b89ec452","Type":"ContainerStarted","Data":"89ea3131312ff426dd4f4704c01bc9dcbbb6ef1d4816b6c29d525b8930764b5e"} Sep 10 17:29:38.075926 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:38.075835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:38.211011 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:38.210981 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:38.315396 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:38.315373 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:38.414516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:38.414433 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:39.555619 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:39.555573 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:39.633876 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:39.633790 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:39.858592 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:39.858560 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" event={"ID":"ff8e73a5-7be4-4b3c-bf93-c885b89ec452","Type":"ContainerStarted","Data":"a141abaf0e6f661f7b8c84121c823c377cc5cfe74db528f2179c9564c1f40f29"} Sep 10 17:29:39.858749 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:39.858624 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:40.554966 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:40.554932 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:45.204702 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.204556 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:45.304290 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.304258 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:45.854768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.854719 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" podStartSLOduration=7.324048824 podStartE2EDuration="8.854701759s" totalImagesPullingTime="1.530652935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:29:39.875227234 +0000 UTC m=+346.895154386" watchObservedRunningTime="2026-09-10 17:29:45.854701759 +0000 UTC m=+352.874628911" Sep 10 17:29:45.856004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.855982 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42"] Sep 10 17:29:45.859167 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.859146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.861386 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.861367 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 17:29:45.861522 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.861507 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gjr7k\"" Sep 10 17:29:45.870389 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.870369 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42"] Sep 10 17:29:45.892383 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.892362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:45.932545 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932634 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932634 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntr26\" (UniqueName: \"kubernetes.io/projected/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-kube-api-access-ntr26\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:45.932911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:45.932800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033112 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033320 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033320 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033320 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033320 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033287 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033320 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntr26\" (UniqueName: \"kubernetes.io/projected/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-kube-api-access-ntr26\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033553 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033518 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033553 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033539 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033713 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033800 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033785 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.033961 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.033928 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.035738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.035707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.035828 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.035790 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.046563 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.046532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.046737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.046717 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntr26\" (UniqueName: \"kubernetes.io/projected/d3d38ade-a3d4-4168-b88a-c32bedc4fe78-kube-api-access-ntr26\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42\" (UID: \"d3d38ade-a3d4-4168-b88a-c32bedc4fe78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.094609 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.094590 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:46.169833 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.169782 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:46.448492 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.448468 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42"] Sep 10 17:29:46.451017 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:29:46.450997 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d38ade_a3d4_4168_b88a_c32bedc4fe78.slice/crio-c50f8a9243fda5b765826e5d95d635dc63437cbfe5b77f8520c75a73742b80bb WatchSource:0}: Error finding container c50f8a9243fda5b765826e5d95d635dc63437cbfe5b77f8520c75a73742b80bb: Status 404 returned error can't find the container with id c50f8a9243fda5b765826e5d95d635dc63437cbfe5b77f8520c75a73742b80bb Sep 10 17:29:46.633082 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.633051 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:46.890150 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:46.890128 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" event={"ID":"d3d38ade-a3d4-4168-b88a-c32bedc4fe78","Type":"ContainerStarted","Data":"c50f8a9243fda5b765826e5d95d635dc63437cbfe5b77f8520c75a73742b80bb"} Sep 10 17:29:48.333376 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.333334 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cmmxn"] Sep 10 17:29:48.340439 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.340405 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:48.342970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.342925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 17:29:48.343688 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.343602 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lzg89\"" Sep 10 17:29:48.346968 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.346946 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cmmxn"] Sep 10 17:29:48.369099 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.369068 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:48.451992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.451963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abde387a-641f-4cb4-82be-fd39c68d92ee-cert\") pod \"odh-model-controller-7998c67dc4-cmmxn\" (UID: \"abde387a-641f-4cb4-82be-fd39c68d92ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:48.452157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.452034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqx8x\" (UniqueName: \"kubernetes.io/projected/abde387a-641f-4cb4-82be-fd39c68d92ee-kube-api-access-rqx8x\") pod \"odh-model-controller-7998c67dc4-cmmxn\" (UID: \"abde387a-641f-4cb4-82be-fd39c68d92ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:48.553284 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.553247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abde387a-641f-4cb4-82be-fd39c68d92ee-cert\") pod \"odh-model-controller-7998c67dc4-cmmxn\" (UID: \"abde387a-641f-4cb4-82be-fd39c68d92ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:48.553440 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.553309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqx8x\" (UniqueName: \"kubernetes.io/projected/abde387a-641f-4cb4-82be-fd39c68d92ee-kube-api-access-rqx8x\") pod \"odh-model-controller-7998c67dc4-cmmxn\" (UID: \"abde387a-641f-4cb4-82be-fd39c68d92ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:48.553440 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:29:48.553420 2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 10 17:29:48.553554 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:29:48.553528 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abde387a-641f-4cb4-82be-fd39c68d92ee-cert podName:abde387a-641f-4cb4-82be-fd39c68d92ee nodeName:}" failed. No retries permitted until 2026-09-10 17:29:49.053504063 +0000 UTC m=+356.073431200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/abde387a-641f-4cb4-82be-fd39c68d92ee-cert") pod "odh-model-controller-7998c67dc4-cmmxn" (UID: "abde387a-641f-4cb4-82be-fd39c68d92ee") : secret "odh-model-controller-webhook-cert" not found Sep 10 17:29:48.566288 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:48.566256 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqx8x\" (UniqueName: \"kubernetes.io/projected/abde387a-641f-4cb4-82be-fd39c68d92ee-kube-api-access-rqx8x\") pod \"odh-model-controller-7998c67dc4-cmmxn\" (UID: \"abde387a-641f-4cb4-82be-fd39c68d92ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:49.056537 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.056500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abde387a-641f-4cb4-82be-fd39c68d92ee-cert\") pod \"odh-model-controller-7998c67dc4-cmmxn\" (UID: \"abde387a-641f-4cb4-82be-fd39c68d92ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:49.059317 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.059291 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abde387a-641f-4cb4-82be-fd39c68d92ee-cert\") pod \"odh-model-controller-7998c67dc4-cmmxn\" (UID: \"abde387a-641f-4cb4-82be-fd39c68d92ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:49.187057 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.187022 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:29:49.187167 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.187096 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:29:49.187167 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.187127 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:29:49.254978 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.254958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:49.486062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.486029 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:49.534478 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.534443 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cmmxn"] Sep 10 17:29:49.536558 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:29:49.536533 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabde387a_641f_4cb4_82be_fd39c68d92ee.slice/crio-7f0cb1e647fcb43fda39c7102fd0e297a9edea38b3b6534216bf39012441bbaf WatchSource:0}: Error finding container 7f0cb1e647fcb43fda39c7102fd0e297a9edea38b3b6534216bf39012441bbaf: Status 404 returned error can't find the container with id 7f0cb1e647fcb43fda39c7102fd0e297a9edea38b3b6534216bf39012441bbaf Sep 10 17:29:49.905987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.905950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" event={"ID":"abde387a-641f-4cb4-82be-fd39c68d92ee","Type":"ContainerStarted","Data":"7f0cb1e647fcb43fda39c7102fd0e297a9edea38b3b6534216bf39012441bbaf"} Sep 10 17:29:49.907439 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.907414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" event={"ID":"d3d38ade-a3d4-4168-b88a-c32bedc4fe78","Type":"ContainerStarted","Data":"95e0b71b962e9fd8e12dc6c32d3876f673672d600670f96ff648e56509d3e0b5"} Sep 10 17:29:49.929336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:49.929296 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" podStartSLOduration=2.195581303 podStartE2EDuration="4.929281703s" totalImagesPullingTime="2.7337004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:29:49.926920392 +0000 UTC m=+356.946847555" watchObservedRunningTime="2026-09-10 17:29:49.929281703 +0000 UTC m=+356.949208854" Sep 10 17:29:50.170422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:50.170359 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:50.174740 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:50.174720 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:50.865248 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:50.865212 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86c5cb66bd-jd4vl" Sep 10 17:29:50.915307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:50.915229 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:50.916409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:50.916338 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42" Sep 10 17:29:52.926543 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:52.926510 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" event={"ID":"abde387a-641f-4cb4-82be-fd39c68d92ee","Type":"ContainerStarted","Data":"eed21ec2e581155c36ffc49a6b9dbf8aa576c318a6b7b413dd5099876781d1b7"} Sep 10 17:29:52.926954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:52.926838 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:29:52.943653 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:52.943589 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" podStartSLOduration=2.137055837 podStartE2EDuration="4.943575715s" totalImagesPullingTime="2.806519878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:29:52.942086431 +0000 UTC m=+359.962013583" watchObservedRunningTime="2026-09-10 17:29:52.943575715 +0000 UTC m=+359.963502867" Sep 10 17:29:55.567689 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.567654 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd"] Sep 10 17:29:55.576028 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.576004 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.578738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.578708 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 17:29:55.578738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.578720 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vr4tj\"" Sep 10 17:29:55.578738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.578730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 17:29:55.578943 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.578748 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 17:29:55.585405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.585382 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd"] Sep 10 17:29:55.612352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.612321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7707128-c45e-4651-8624-670f12ee5796-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.612352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.612352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7707128-c45e-4651-8624-670f12ee5796-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.612528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.612378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhp9q\" (UniqueName: \"kubernetes.io/projected/e7707128-c45e-4651-8624-670f12ee5796-kube-api-access-xhp9q\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.612528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.612440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.612528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.612473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.612528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.612507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7707128-c45e-4651-8624-670f12ee5796-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.612681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.612540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.713854 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.713826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhp9q\" (UniqueName: \"kubernetes.io/projected/e7707128-c45e-4651-8624-670f12ee5796-kube-api-access-xhp9q\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.713994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.713864 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.713994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.713882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.713994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.713911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7707128-c45e-4651-8624-670f12ee5796-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.713994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.713940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.713994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.713981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7707128-c45e-4651-8624-670f12ee5796-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.713994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.713996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7707128-c45e-4651-8624-670f12ee5796-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.714681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.714632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7707128-c45e-4651-8624-670f12ee5796-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.716464 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.716441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.716588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.716441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.716762 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.716734 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7707128-c45e-4651-8624-670f12ee5796-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.716898 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.716880 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7707128-c45e-4651-8624-670f12ee5796-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.723796 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.723771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7707128-c45e-4651-8624-670f12ee5796-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.724201 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.724180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhp9q\" (UniqueName: \"kubernetes.io/projected/e7707128-c45e-4651-8624-670f12ee5796-kube-api-access-xhp9q\") pod \"istiod-openshift-gateway-5677ccb49b-d7dqd\" (UID: \"e7707128-c45e-4651-8624-670f12ee5796\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:55.886670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:55.886597 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:56.234963 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:29:56.234938 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7707128_c45e_4651_8624_670f12ee5796.slice/crio-bf92ddc7fe408034e7feb349f2f5dfc4f677d1c834e65d1710e8d5970e86e672 WatchSource:0}: Error finding container bf92ddc7fe408034e7feb349f2f5dfc4f677d1c834e65d1710e8d5970e86e672: Status 404 returned error can't find the container with id bf92ddc7fe408034e7feb349f2f5dfc4f677d1c834e65d1710e8d5970e86e672 Sep 10 17:29:56.235275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:56.235251 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd"] Sep 10 17:29:56.946398 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:56.946361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" event={"ID":"e7707128-c45e-4651-8624-670f12ee5796","Type":"ContainerStarted","Data":"bf92ddc7fe408034e7feb349f2f5dfc4f677d1c834e65d1710e8d5970e86e672"} Sep 10 17:29:58.450520 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:58.450479 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:29:58.450844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:58.450563 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:29:58.502073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:58.502042 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:58.641778 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:58.641746 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:58.958692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:58.958653 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" event={"ID":"e7707128-c45e-4651-8624-670f12ee5796","Type":"ContainerStarted","Data":"3c21c70b82a2607b36e74523fec84c1d4ae86991521fec391f888a122e470e49"} Sep 10 17:29:58.958927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:58.958908 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:58.997778 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:58.997737 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" podStartSLOduration=1.784819073 podStartE2EDuration="3.997723313s" totalImagesPullingTime="2.21290424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:29:58.996335428 +0000 UTC m=+366.016262580" watchObservedRunningTime="2026-09-10 17:29:58.997723313 +0000 UTC m=+366.017650464" Sep 10 17:29:59.027121 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:59.027080 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:59.125550 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:59.125516 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:59.829992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:59.829966 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:59.930162 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:59.930133 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:29:59.964463 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:59.964442 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd" Sep 10 17:29:59.994671 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:29:59.994632 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:30:04.938535 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:04.938506 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-cmmxn" Sep 10 17:30:46.532191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:46.532155 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:30:46.588225 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:46.588198 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:30:49.482069 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:49.482034 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:30:49.582006 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:49.581971 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:30:53.669928 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.669892 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd"] Sep 10 17:30:53.672476 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.672456 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.674749 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.674730 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 17:30:53.674836 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.674730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z4mth\"" Sep 10 17:30:53.674836 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.674788 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 17:30:53.682985 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.682967 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd"] Sep 10 17:30:53.740533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.740497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.740685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.740566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.740685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.740666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27j7s\" (UniqueName: \"kubernetes.io/projected/d811cb59-6614-476f-86f7-bdf82138eb8d-kube-api-access-27j7s\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.764470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.764444 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn"] Sep 10 17:30:53.766842 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.766827 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.777163 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.777145 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn"] Sep 10 17:30:53.841978 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.841952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.842113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.841981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.842113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.842007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.842113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.842050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27j7s\" (UniqueName: \"kubernetes.io/projected/d811cb59-6614-476f-86f7-bdf82138eb8d-kube-api-access-27j7s\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.842113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.842080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zcb\" (UniqueName: \"kubernetes.io/projected/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-kube-api-access-p8zcb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.842113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.842102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.842406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.842388 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.842406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.842394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.850843 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.850820 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27j7s\" (UniqueName: \"kubernetes.io/projected/d811cb59-6614-476f-86f7-bdf82138eb8d-kube-api-access-27j7s\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:53.862749 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.862729 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr"] Sep 10 17:30:53.865564 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.865550 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:53.875017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.874995 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr"] Sep 10 17:30:53.942761 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.942697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz689\" (UniqueName: \"kubernetes.io/projected/45537a23-f373-4950-9d44-6f2e91c55b07-kube-api-access-gz689\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:53.942761 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.942753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.942895 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.942818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.942895 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.942869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:53.942992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.942909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zcb\" (UniqueName: \"kubernetes.io/projected/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-kube-api-access-p8zcb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.942992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.942950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:53.943110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.943090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.943170 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.943104 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.951546 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.951518 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zcb\" (UniqueName: \"kubernetes.io/projected/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-kube-api-access-p8zcb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:53.966484 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.966461 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k"] Sep 10 17:30:53.969052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.969037 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:53.977959 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.977936 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k"] Sep 10 17:30:53.980990 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:53.980971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:54.043290 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:54.043414 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czkcf\" (UniqueName: \"kubernetes.io/projected/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-kube-api-access-czkcf\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.043414 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:54.043414 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.043567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz689\" (UniqueName: \"kubernetes.io/projected/45537a23-f373-4950-9d44-6f2e91c55b07-kube-api-access-gz689\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:54.043567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.043708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043675 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:54.043765 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.043715 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:54.054118 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.054091 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz689\" (UniqueName: \"kubernetes.io/projected/45537a23-f373-4950-9d44-6f2e91c55b07-kube-api-access-gz689\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:54.075724 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.075700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:54.144417 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.144382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czkcf\" (UniqueName: \"kubernetes.io/projected/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-kube-api-access-czkcf\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.144552 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.144447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.145202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.144688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.145202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.145161 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.145202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.145161 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.152785 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.152762 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czkcf\" (UniqueName: \"kubernetes.io/projected/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-kube-api-access-czkcf\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.174830 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.174796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:54.259058 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.259032 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd"] Sep 10 17:30:54.261060 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:30:54.261034 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd811cb59_6614_476f_86f7_bdf82138eb8d.slice/crio-fd0e9011b2a97712e3cde4990d61a3d6bf1efc64d5f7016b5559f1bdb1095ac0 WatchSource:0}: Error finding container fd0e9011b2a97712e3cde4990d61a3d6bf1efc64d5f7016b5559f1bdb1095ac0: Status 404 returned error can't find the container with id fd0e9011b2a97712e3cde4990d61a3d6bf1efc64d5f7016b5559f1bdb1095ac0 Sep 10 17:30:54.278853 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.278817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:30:54.348369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.348341 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn"] Sep 10 17:30:54.352307 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:30:54.352218 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e570fc_4e7f_42bf_b39b_6c81d13426cf.slice/crio-0f460aab9aa6083378217f5fdd3a280a4c040d79bc8db9fc2c390bfe62e5f9e5 WatchSource:0}: Error finding container 0f460aab9aa6083378217f5fdd3a280a4c040d79bc8db9fc2c390bfe62e5f9e5: Status 404 returned error can't find the container with id 0f460aab9aa6083378217f5fdd3a280a4c040d79bc8db9fc2c390bfe62e5f9e5 Sep 10 17:30:54.446318 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.446289 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr"] Sep 10 17:30:54.453119 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:30:54.453091 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45537a23_f373_4950_9d44_6f2e91c55b07.slice/crio-5a1b8ddad6d48ce00a92755ee438a66da6d6e28f012b9e86cc70cf1bf03d5f46 WatchSource:0}: Error finding container 5a1b8ddad6d48ce00a92755ee438a66da6d6e28f012b9e86cc70cf1bf03d5f46: Status 404 returned error can't find the container with id 5a1b8ddad6d48ce00a92755ee438a66da6d6e28f012b9e86cc70cf1bf03d5f46 Sep 10 17:30:54.551570 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:54.551548 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k"] Sep 10 17:30:54.594464 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:30:54.594427 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f63f82d_de1c_414e_bfd4_fc2795d83ea5.slice/crio-ba8edce0379ae961ded40e139fe6201c8a2b3119f641387c58a0ddb067e8816e WatchSource:0}: Error finding container ba8edce0379ae961ded40e139fe6201c8a2b3119f641387c58a0ddb067e8816e: Status 404 returned error can't find the container with id ba8edce0379ae961ded40e139fe6201c8a2b3119f641387c58a0ddb067e8816e Sep 10 17:30:55.222508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.222474 2580 generic.go:356] "Generic (PLEG): container finished" podID="45537a23-f373-4950-9d44-6f2e91c55b07" containerID="5ac2fce094959bf19dd7f5f92f82a38dee6efedec4204cfd95655449de419abf" exitCode=0 Sep 10 17:30:55.222907 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.222557 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" event={"ID":"45537a23-f373-4950-9d44-6f2e91c55b07","Type":"ContainerDied","Data":"5ac2fce094959bf19dd7f5f92f82a38dee6efedec4204cfd95655449de419abf"} Sep 10 17:30:55.222907 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.222611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" event={"ID":"45537a23-f373-4950-9d44-6f2e91c55b07","Type":"ContainerStarted","Data":"5a1b8ddad6d48ce00a92755ee438a66da6d6e28f012b9e86cc70cf1bf03d5f46"} Sep 10 17:30:55.224261 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.224234 2580 generic.go:356] "Generic (PLEG): container finished" podID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerID="c30c42ae725f46f3521b7e952e0218636fc0b98c1f7603b0d48c29b0e01fc1ae" exitCode=0 Sep 10 17:30:55.224391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.224316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" event={"ID":"9f63f82d-de1c-414e-bfd4-fc2795d83ea5","Type":"ContainerDied","Data":"c30c42ae725f46f3521b7e952e0218636fc0b98c1f7603b0d48c29b0e01fc1ae"} Sep 10 17:30:55.224391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.224373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" event={"ID":"9f63f82d-de1c-414e-bfd4-fc2795d83ea5","Type":"ContainerStarted","Data":"ba8edce0379ae961ded40e139fe6201c8a2b3119f641387c58a0ddb067e8816e"} Sep 10 17:30:55.225961 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.225935 2580 generic.go:356] "Generic (PLEG): container finished" podID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerID="961b54bd0974ad5673d8a31d7c02862a54e591df61d0c58d2fb375cb57ed150e" exitCode=0 Sep 10 17:30:55.226074 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.226041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" event={"ID":"d811cb59-6614-476f-86f7-bdf82138eb8d","Type":"ContainerDied","Data":"961b54bd0974ad5673d8a31d7c02862a54e591df61d0c58d2fb375cb57ed150e"} Sep 10 17:30:55.226150 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.226081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" event={"ID":"d811cb59-6614-476f-86f7-bdf82138eb8d","Type":"ContainerStarted","Data":"fd0e9011b2a97712e3cde4990d61a3d6bf1efc64d5f7016b5559f1bdb1095ac0"} Sep 10 17:30:55.227926 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.227906 2580 generic.go:356] "Generic (PLEG): container finished" podID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerID="8201b042431d585732ed1db89350c2f2dc15e240ae8d8777ada2cfaa2aa471c1" exitCode=0 Sep 10 17:30:55.228004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.227953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" event={"ID":"a3e570fc-4e7f-42bf-b39b-6c81d13426cf","Type":"ContainerDied","Data":"8201b042431d585732ed1db89350c2f2dc15e240ae8d8777ada2cfaa2aa471c1"} Sep 10 17:30:55.228004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:55.227981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" event={"ID":"a3e570fc-4e7f-42bf-b39b-6c81d13426cf","Type":"ContainerStarted","Data":"0f460aab9aa6083378217f5fdd3a280a4c040d79bc8db9fc2c390bfe62e5f9e5"} Sep 10 17:30:56.235375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:56.235342 2580 generic.go:356] "Generic (PLEG): container finished" podID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerID="c99777a4b91e6463eb9323688c161a063f5c6582cd4f54736ff802fc465de194" exitCode=0 Sep 10 17:30:56.235757 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:56.235421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" event={"ID":"a3e570fc-4e7f-42bf-b39b-6c81d13426cf","Type":"ContainerDied","Data":"c99777a4b91e6463eb9323688c161a063f5c6582cd4f54736ff802fc465de194"} Sep 10 17:30:57.241976 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:57.241943 2580 generic.go:356] "Generic (PLEG): container finished" podID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerID="0a19ca0569573b152080804e859752e313c8411c787550afabdbf7f498cc8ffc" exitCode=0 Sep 10 17:30:57.242387 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:57.242027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" event={"ID":"d811cb59-6614-476f-86f7-bdf82138eb8d","Type":"ContainerDied","Data":"0a19ca0569573b152080804e859752e313c8411c787550afabdbf7f498cc8ffc"} Sep 10 17:30:57.244449 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:57.244428 2580 generic.go:356] "Generic (PLEG): container finished" podID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerID="10af3edf65a5f4531d0ff7602fe675a8ee69d0fd5b9d92c2ed0b27122ce19ea4" exitCode=0 Sep 10 17:30:57.244534 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:57.244506 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" event={"ID":"a3e570fc-4e7f-42bf-b39b-6c81d13426cf","Type":"ContainerDied","Data":"10af3edf65a5f4531d0ff7602fe675a8ee69d0fd5b9d92c2ed0b27122ce19ea4"} Sep 10 17:30:57.246511 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:57.246490 2580 generic.go:356] "Generic (PLEG): container finished" podID="45537a23-f373-4950-9d44-6f2e91c55b07" containerID="036978f9040cb866d3fb28970607a18c1b19ef2b6fffd8e7f6a348fd960b00d4" exitCode=0 Sep 10 17:30:57.246578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:57.246524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" event={"ID":"45537a23-f373-4950-9d44-6f2e91c55b07","Type":"ContainerDied","Data":"036978f9040cb866d3fb28970607a18c1b19ef2b6fffd8e7f6a348fd960b00d4"} Sep 10 17:30:58.254311 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.254283 2580 generic.go:356] "Generic (PLEG): container finished" podID="45537a23-f373-4950-9d44-6f2e91c55b07" containerID="d2132e170601ef4bf61ab7cf9dfbd2414ff71ad0e18a9c74bd7425316daec770" exitCode=0 Sep 10 17:30:58.254749 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.254371 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" event={"ID":"45537a23-f373-4950-9d44-6f2e91c55b07","Type":"ContainerDied","Data":"d2132e170601ef4bf61ab7cf9dfbd2414ff71ad0e18a9c74bd7425316daec770"} Sep 10 17:30:58.256603 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.256579 2580 generic.go:356] "Generic (PLEG): container finished" podID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerID="766f1950b6857fbb9419acce82525bc2e43e1447e2bbc6c814c211cd8e223d69" exitCode=0 Sep 10 17:30:58.256723 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.256665 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" event={"ID":"d811cb59-6614-476f-86f7-bdf82138eb8d","Type":"ContainerDied","Data":"766f1950b6857fbb9419acce82525bc2e43e1447e2bbc6c814c211cd8e223d69"} Sep 10 17:30:58.385484 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.385464 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:58.480157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.480131 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8zcb\" (UniqueName: \"kubernetes.io/projected/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-kube-api-access-p8zcb\") pod \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " Sep 10 17:30:58.480282 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.480173 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-util\") pod \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " Sep 10 17:30:58.480282 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.480201 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-bundle\") pod \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\" (UID: \"a3e570fc-4e7f-42bf-b39b-6c81d13426cf\") " Sep 10 17:30:58.480859 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.480830 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-bundle" (OuterVolumeSpecName: "bundle") pod "a3e570fc-4e7f-42bf-b39b-6c81d13426cf" (UID: "a3e570fc-4e7f-42bf-b39b-6c81d13426cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:30:58.482833 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.482791 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-kube-api-access-p8zcb" (OuterVolumeSpecName: "kube-api-access-p8zcb") pod "a3e570fc-4e7f-42bf-b39b-6c81d13426cf" (UID: "a3e570fc-4e7f-42bf-b39b-6c81d13426cf"). InnerVolumeSpecName "kube-api-access-p8zcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:30:58.486316 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.486293 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-util" (OuterVolumeSpecName: "util") pod "a3e570fc-4e7f-42bf-b39b-6c81d13426cf" (UID: "a3e570fc-4e7f-42bf-b39b-6c81d13426cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:30:58.581267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.581217 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8zcb\" (UniqueName: \"kubernetes.io/projected/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-kube-api-access-p8zcb\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:58.581267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.581237 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:58.581267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:58.581246 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e570fc-4e7f-42bf-b39b-6c81d13426cf-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:59.263154 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.263118 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" Sep 10 17:30:59.263509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.263123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c48sjn" event={"ID":"a3e570fc-4e7f-42bf-b39b-6c81d13426cf","Type":"ContainerDied","Data":"0f460aab9aa6083378217f5fdd3a280a4c040d79bc8db9fc2c390bfe62e5f9e5"} Sep 10 17:30:59.263509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.263277 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f460aab9aa6083378217f5fdd3a280a4c040d79bc8db9fc2c390bfe62e5f9e5" Sep 10 17:30:59.410750 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.410726 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:30:59.413674 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.413657 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:30:59.488797 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.488771 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27j7s\" (UniqueName: \"kubernetes.io/projected/d811cb59-6614-476f-86f7-bdf82138eb8d-kube-api-access-27j7s\") pod \"d811cb59-6614-476f-86f7-bdf82138eb8d\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " Sep 10 17:30:59.488927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.488800 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz689\" (UniqueName: \"kubernetes.io/projected/45537a23-f373-4950-9d44-6f2e91c55b07-kube-api-access-gz689\") pod \"45537a23-f373-4950-9d44-6f2e91c55b07\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " Sep 10 17:30:59.488927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.488843 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-util\") pod \"45537a23-f373-4950-9d44-6f2e91c55b07\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " Sep 10 17:30:59.488927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.488871 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-util\") pod \"d811cb59-6614-476f-86f7-bdf82138eb8d\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " Sep 10 17:30:59.488927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.488914 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-bundle\") pod \"45537a23-f373-4950-9d44-6f2e91c55b07\" (UID: \"45537a23-f373-4950-9d44-6f2e91c55b07\") " Sep 10 17:30:59.489152 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.488976 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-bundle\") pod \"d811cb59-6614-476f-86f7-bdf82138eb8d\" (UID: \"d811cb59-6614-476f-86f7-bdf82138eb8d\") " Sep 10 17:30:59.489416 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.489390 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-bundle" (OuterVolumeSpecName: "bundle") pod "45537a23-f373-4950-9d44-6f2e91c55b07" (UID: "45537a23-f373-4950-9d44-6f2e91c55b07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:30:59.489776 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.489747 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-bundle" (OuterVolumeSpecName: "bundle") pod "d811cb59-6614-476f-86f7-bdf82138eb8d" (UID: "d811cb59-6614-476f-86f7-bdf82138eb8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:30:59.491481 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.491446 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45537a23-f373-4950-9d44-6f2e91c55b07-kube-api-access-gz689" (OuterVolumeSpecName: "kube-api-access-gz689") pod "45537a23-f373-4950-9d44-6f2e91c55b07" (UID: "45537a23-f373-4950-9d44-6f2e91c55b07"). InnerVolumeSpecName "kube-api-access-gz689". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:30:59.491854 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.491820 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d811cb59-6614-476f-86f7-bdf82138eb8d-kube-api-access-27j7s" (OuterVolumeSpecName: "kube-api-access-27j7s") pod "d811cb59-6614-476f-86f7-bdf82138eb8d" (UID: "d811cb59-6614-476f-86f7-bdf82138eb8d"). InnerVolumeSpecName "kube-api-access-27j7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:30:59.495228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.495205 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-util" (OuterVolumeSpecName: "util") pod "d811cb59-6614-476f-86f7-bdf82138eb8d" (UID: "d811cb59-6614-476f-86f7-bdf82138eb8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:30:59.495465 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.495443 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-util" (OuterVolumeSpecName: "util") pod "45537a23-f373-4950-9d44-6f2e91c55b07" (UID: "45537a23-f373-4950-9d44-6f2e91c55b07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:30:59.590524 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.590465 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:59.590524 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.590497 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27j7s\" (UniqueName: \"kubernetes.io/projected/d811cb59-6614-476f-86f7-bdf82138eb8d-kube-api-access-27j7s\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:59.590524 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.590507 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz689\" (UniqueName: \"kubernetes.io/projected/45537a23-f373-4950-9d44-6f2e91c55b07-kube-api-access-gz689\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:59.590524 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.590515 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:59.590524 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.590523 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d811cb59-6614-476f-86f7-bdf82138eb8d-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:30:59.590524 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:30:59.590530 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45537a23-f373-4950-9d44-6f2e91c55b07-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:31:00.270923 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:00.270899 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" Sep 10 17:31:00.271304 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:00.270923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cxcfr" event={"ID":"45537a23-f373-4950-9d44-6f2e91c55b07","Type":"ContainerDied","Data":"5a1b8ddad6d48ce00a92755ee438a66da6d6e28f012b9e86cc70cf1bf03d5f46"} Sep 10 17:31:00.271304 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:00.270972 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a1b8ddad6d48ce00a92755ee438a66da6d6e28f012b9e86cc70cf1bf03d5f46" Sep 10 17:31:00.272969 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:00.272944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" event={"ID":"d811cb59-6614-476f-86f7-bdf82138eb8d","Type":"ContainerDied","Data":"fd0e9011b2a97712e3cde4990d61a3d6bf1efc64d5f7016b5559f1bdb1095ac0"} Sep 10 17:31:00.273093 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:00.272978 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7bpd" Sep 10 17:31:00.273093 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:00.272981 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd0e9011b2a97712e3cde4990d61a3d6bf1efc64d5f7016b5559f1bdb1095ac0" Sep 10 17:31:16.353390 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:16.353360 2580 generic.go:356] "Generic (PLEG): container finished" podID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerID="dcd39274befbc356b3f7d7079d23c326793a04abd9978bf66b71cbc6615caca2" exitCode=0 Sep 10 17:31:16.353788 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:16.353454 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" event={"ID":"9f63f82d-de1c-414e-bfd4-fc2795d83ea5","Type":"ContainerDied","Data":"dcd39274befbc356b3f7d7079d23c326793a04abd9978bf66b71cbc6615caca2"} Sep 10 17:31:17.360744 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:17.360705 2580 generic.go:356] "Generic (PLEG): container finished" podID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerID="f0cf393a857e56a31909e94271658d2915dd1ff0708745ec774336839d956c87" exitCode=0 Sep 10 17:31:17.361128 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:17.360779 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" event={"ID":"9f63f82d-de1c-414e-bfd4-fc2795d83ea5","Type":"ContainerDied","Data":"f0cf393a857e56a31909e94271658d2915dd1ff0708745ec774336839d956c87"} Sep 10 17:31:18.487733 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.487711 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:31:18.533228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.533204 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-util\") pod \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " Sep 10 17:31:18.533340 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.533265 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czkcf\" (UniqueName: \"kubernetes.io/projected/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-kube-api-access-czkcf\") pod \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " Sep 10 17:31:18.533340 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.533321 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-bundle\") pod \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\" (UID: \"9f63f82d-de1c-414e-bfd4-fc2795d83ea5\") " Sep 10 17:31:18.533892 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.533862 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-bundle" (OuterVolumeSpecName: "bundle") pod "9f63f82d-de1c-414e-bfd4-fc2795d83ea5" (UID: "9f63f82d-de1c-414e-bfd4-fc2795d83ea5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:31:18.535333 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.535310 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-kube-api-access-czkcf" (OuterVolumeSpecName: "kube-api-access-czkcf") pod "9f63f82d-de1c-414e-bfd4-fc2795d83ea5" (UID: "9f63f82d-de1c-414e-bfd4-fc2795d83ea5"). InnerVolumeSpecName "kube-api-access-czkcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:31:18.537789 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.537770 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-util" (OuterVolumeSpecName: "util") pod "9f63f82d-de1c-414e-bfd4-fc2795d83ea5" (UID: "9f63f82d-de1c-414e-bfd4-fc2795d83ea5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:31:18.634460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.634406 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czkcf\" (UniqueName: \"kubernetes.io/projected/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-kube-api-access-czkcf\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:31:18.634460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.634434 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-bundle\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:31:18.634460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:18.634445 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f63f82d-de1c-414e-bfd4-fc2795d83ea5-util\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:31:19.372403 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:19.372376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" event={"ID":"9f63f82d-de1c-414e-bfd4-fc2795d83ea5","Type":"ContainerDied","Data":"ba8edce0379ae961ded40e139fe6201c8a2b3119f641387c58a0ddb067e8816e"} Sep 10 17:31:19.372525 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:19.372403 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cqm5k" Sep 10 17:31:19.372525 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:19.372415 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba8edce0379ae961ded40e139fe6201c8a2b3119f641387c58a0ddb067e8816e" Sep 10 17:31:21.892377 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:21.892342 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:21.993221 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:21.993196 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:26.694346 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:26.694315 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:29.298580 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:29.298544 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:29.753045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:29.753011 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:30.108023 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:30.107953 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:32.884069 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:32.884038 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:32.994147 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:32.994114 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:33.080205 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:33.080172 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:33.146272 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:33.146207 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:33.691994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:33.691958 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:33.982581 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:33.982548 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:34.086409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:34.086382 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:35.598748 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:35.598712 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:36.320298 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:36.320268 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:36.939932 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:36.939895 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:39.311707 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:39.311675 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:39.416782 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:39.416742 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:40.390419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:40.390386 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:40.784682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:40.784626 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:43.294509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:43.294470 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:43.352685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:43.352662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:43.696501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:43.696416 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:43.798908 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:43.798875 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:43.904107 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:43.904048 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:44.010794 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:44.010767 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:52.295033 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:52.295000 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:52.385076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:52.385043 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:52.875894 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:52.875843 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:52.965584 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:52.965547 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:55.325839 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:55.325794 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:55.432409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:55.432368 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:57.293122 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:57.293083 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:31:57.390143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:31:57.390115 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:01.259280 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:01.259237 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:01.360491 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:01.360464 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:05.266751 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:05.266719 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:05.366530 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:05.366492 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:05.668577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:05.668498 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:05.763009 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:05.762961 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:06.071162 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:06.071126 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:06.174486 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:06.174455 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:14.467980 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:14.467934 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:14.566171 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:14.566145 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:16.919413 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:16.919363 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:17.021805 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:17.021775 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:21.233621 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233592 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5"] Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233931 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerName="extract" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233944 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerName="extract" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233952 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerName="extract" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233957 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerName="extract" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233964 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45537a23-f373-4950-9d44-6f2e91c55b07" containerName="extract" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233969 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="45537a23-f373-4950-9d44-6f2e91c55b07" containerName="extract" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233979 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerName="util" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233985 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerName="util" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233990 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerName="util" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.233995 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerName="util" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234003 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerName="pull" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234007 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerName="pull" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234015 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerName="pull" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234020 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerName="pull" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234026 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45537a23-f373-4950-9d44-6f2e91c55b07" containerName="util" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234031 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="45537a23-f373-4950-9d44-6f2e91c55b07" containerName="util" Sep 10 17:32:21.234031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234036 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerName="extract" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234041 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerName="extract" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234048 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45537a23-f373-4950-9d44-6f2e91c55b07" containerName="pull" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234053 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="45537a23-f373-4950-9d44-6f2e91c55b07" containerName="pull" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234063 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerName="pull" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234068 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerName="pull" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234076 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerName="util" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234081 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerName="util" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234130 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f63f82d-de1c-414e-bfd4-fc2795d83ea5" containerName="extract" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234138 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d811cb59-6614-476f-86f7-bdf82138eb8d" containerName="extract" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234143 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3e570fc-4e7f-42bf-b39b-6c81d13426cf" containerName="extract" Sep 10 17:32:21.234604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.234151 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="45537a23-f373-4950-9d44-6f2e91c55b07" containerName="extract" Sep 10 17:32:21.236944 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.236928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.239345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.239326 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8kwhp\"" Sep 10 17:32:21.252776 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.252752 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5"] Sep 10 17:32:21.273271 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.273244 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:21.392943 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.392916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.392984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.393000 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndv9\" (UniqueName: \"kubernetes.io/projected/28e4666c-2a88-4f4b-b935-a630c4228a26-kube-api-access-fndv9\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.393037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.393064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.393127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.393149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.393168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.393332 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.393193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28e4666c-2a88-4f4b-b935-a630c4228a26-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494387 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494387 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndv9\" (UniqueName: \"kubernetes.io/projected/28e4666c-2a88-4f4b-b935-a630c4228a26-kube-api-access-fndv9\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494781 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494756 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494849 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494882 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.494970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.494909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28e4666c-2a88-4f4b-b935-a630c4228a26-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.495458 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.495441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28e4666c-2a88-4f4b-b935-a630c4228a26-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.496927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.496907 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.497022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.496969 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.503960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.503937 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28e4666c-2a88-4f4b-b935-a630c4228a26-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.504192 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.504167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndv9\" (UniqueName: \"kubernetes.io/projected/28e4666c-2a88-4f4b-b935-a630c4228a26-kube-api-access-fndv9\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nbdb5\" (UID: \"28e4666c-2a88-4f4b-b935-a630c4228a26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.546934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.546915 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:21.601778 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.601749 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:21.824526 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.824505 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5"] Sep 10 17:32:21.826227 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:32:21.826187 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e4666c_2a88_4f4b_b935_a630c4228a26.slice/crio-4fd443d32527f32675505cc10acce5afe3f04651f6eaf42aa0765b9ff16174d9 WatchSource:0}: Error finding container 4fd443d32527f32675505cc10acce5afe3f04651f6eaf42aa0765b9ff16174d9: Status 404 returned error can't find the container with id 4fd443d32527f32675505cc10acce5afe3f04651f6eaf42aa0765b9ff16174d9 Sep 10 17:32:21.828167 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.828129 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:32:21.828251 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.828203 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:32:21.828251 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:21.828234 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:32:22.668303 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:22.668269 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" event={"ID":"28e4666c-2a88-4f4b-b935-a630c4228a26","Type":"ContainerStarted","Data":"c8787453696059714413b9a7606f701050de94857d87a96bd82838a30fc408da"} Sep 10 17:32:22.668700 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:22.668328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" event={"ID":"28e4666c-2a88-4f4b-b935-a630c4228a26","Type":"ContainerStarted","Data":"4fd443d32527f32675505cc10acce5afe3f04651f6eaf42aa0765b9ff16174d9"} Sep 10 17:32:22.688274 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:22.688230 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" podStartSLOduration=1.688214065 podStartE2EDuration="1.688214065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:32:22.687270108 +0000 UTC m=+509.707197262" watchObservedRunningTime="2026-09-10 17:32:22.688214065 +0000 UTC m=+509.708141215" Sep 10 17:32:23.547864 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:23.547838 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:23.552608 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:23.552586 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:23.654783 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:23.654753 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:23.672886 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:23.672868 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:23.673704 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:23.673686 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:32:23.758792 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:23.758753 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:23.813063 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:23.812979 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:24.509387 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:24.509351 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:24.613719 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:24.613686 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:44.887353 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:44.887274 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:45.034938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:45.034906 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:45.344456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:45.344421 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:51.243784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:51.243720 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:51.344982 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:51.344940 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:57.408044 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:57.407996 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:32:57.588930 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:32:57.588893 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:03.824062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:03.824027 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:03.904830 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:03.904795 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:03.967856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:03.967830 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:04.047227 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:04.047203 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:04.211384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:04.211352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:07.403089 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:07.403033 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:07.501755 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:07.501705 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:20.011912 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:20.011869 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:22.996861 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:22.996823 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:23.050816 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:23.050791 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:27.790396 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:27.790352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:27.847564 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:27.847525 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:36.359657 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:36.359610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:36.453525 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:36.453486 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:37.807566 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:37.807541 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:37.904382 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:37.904347 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:37.974468 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:37.974444 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:38.100364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.100286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:38.333148 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.333113 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:38.451990 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.451957 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:38.485112 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.485082 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2f4pf"] Sep 10 17:33:38.489028 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.489008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:38.495764 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.495592 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 17:33:38.502183 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.502166 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wq8rk\"" Sep 10 17:33:38.514235 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.514212 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2f4pf"] Sep 10 17:33:38.652600 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.652573 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a240dad-cbbd-4e69-a10a-a56bf3221468-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2f4pf\" (UID: \"3a240dad-cbbd-4e69-a10a-a56bf3221468\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:38.652911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.652612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqbxg\" (UniqueName: \"kubernetes.io/projected/3a240dad-cbbd-4e69-a10a-a56bf3221468-kube-api-access-rqbxg\") pod \"payload-processing-5b54b7fbb7-2f4pf\" (UID: \"3a240dad-cbbd-4e69-a10a-a56bf3221468\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:38.753588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.753508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a240dad-cbbd-4e69-a10a-a56bf3221468-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2f4pf\" (UID: \"3a240dad-cbbd-4e69-a10a-a56bf3221468\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:38.753588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.753551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqbxg\" (UniqueName: \"kubernetes.io/projected/3a240dad-cbbd-4e69-a10a-a56bf3221468-kube-api-access-rqbxg\") pod \"payload-processing-5b54b7fbb7-2f4pf\" (UID: \"3a240dad-cbbd-4e69-a10a-a56bf3221468\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:38.754258 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.754231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a240dad-cbbd-4e69-a10a-a56bf3221468-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2f4pf\" (UID: \"3a240dad-cbbd-4e69-a10a-a56bf3221468\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:38.766227 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.766196 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqbxg\" (UniqueName: \"kubernetes.io/projected/3a240dad-cbbd-4e69-a10a-a56bf3221468-kube-api-access-rqbxg\") pod \"payload-processing-5b54b7fbb7-2f4pf\" (UID: \"3a240dad-cbbd-4e69-a10a-a56bf3221468\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:38.799212 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:38.799191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:39.070124 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:39.070100 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2f4pf"] Sep 10 17:33:39.071630 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:33:39.071606 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a240dad_cbbd_4e69_a10a_a56bf3221468.slice/crio-536ca258a2db95691d89460ff80609eb874d81e7e8a54dac0de908749fa75a71 WatchSource:0}: Error finding container 536ca258a2db95691d89460ff80609eb874d81e7e8a54dac0de908749fa75a71: Status 404 returned error can't find the container with id 536ca258a2db95691d89460ff80609eb874d81e7e8a54dac0de908749fa75a71 Sep 10 17:33:40.059539 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:40.059456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" event={"ID":"3a240dad-cbbd-4e69-a10a-a56bf3221468","Type":"ContainerStarted","Data":"536ca258a2db95691d89460ff80609eb874d81e7e8a54dac0de908749fa75a71"} Sep 10 17:33:41.513826 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:41.513791 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:42.071035 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:42.071005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" event={"ID":"3a240dad-cbbd-4e69-a10a-a56bf3221468","Type":"ContainerStarted","Data":"4235378d053632a03f157fbedad2b47188af8e1898965f0cc242fe6098215b4e"} Sep 10 17:33:42.071220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:42.071113 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:42.097702 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:42.097650 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" podStartSLOduration=2.150377325 podStartE2EDuration="4.09761585s" totalImagesPullingTime="1.947238525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:33:42.09599753 +0000 UTC m=+589.115924683" watchObservedRunningTime="2026-09-10 17:33:42.09761585 +0000 UTC m=+589.117543003" Sep 10 17:33:48.103133 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.103080 2580 generic.go:356] "Generic (PLEG): container finished" podID="28e4666c-2a88-4f4b-b935-a630c4228a26" containerID="c8787453696059714413b9a7606f701050de94857d87a96bd82838a30fc408da" exitCode=0 Sep 10 17:33:48.103450 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.103154 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" event={"ID":"28e4666c-2a88-4f4b-b935-a630c4228a26","Type":"ContainerDied","Data":"c8787453696059714413b9a7606f701050de94857d87a96bd82838a30fc408da"} Sep 10 17:33:48.103582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.103566 2580 scope.go:117] "RemoveContainer" containerID="c8787453696059714413b9a7606f701050de94857d87a96bd82838a30fc408da" Sep 10 17:33:48.104559 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.104535 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:33:48.104632 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.104618 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:33:48.104692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.104680 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:33:48.318681 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.318625 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:48.420573 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:48.420475 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:49.109967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:49.109934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" event={"ID":"28e4666c-2a88-4f4b-b935-a630c4228a26","Type":"ContainerStarted","Data":"811a674bf488276388d16d76ea54ec101de301a5f4dafb39c9a5cdf9ddfebe36"} Sep 10 17:33:49.170565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:49.170531 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:49.275771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:49.275734 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:33:49.548293 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:49.548260 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:33:49.549180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:49.549154 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nbdb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Sep 10 17:33:49.549384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:49.549359 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" podUID="28e4666c-2a88-4f4b-b935-a630c4228a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Sep 10 17:33:50.547710 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:50.547670 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nbdb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Sep 10 17:33:50.548179 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:50.547744 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" podUID="28e4666c-2a88-4f4b-b935-a630c4228a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Sep 10 17:33:51.548079 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:51.548044 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nbdb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Sep 10 17:33:51.548682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:51.548630 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" podUID="28e4666c-2a88-4f4b-b935-a630c4228a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Sep 10 17:33:52.547480 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:52.547442 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nbdb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Sep 10 17:33:52.547801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:52.547772 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" podUID="28e4666c-2a88-4f4b-b935-a630c4228a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Sep 10 17:33:53.078713 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:53.078684 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2f4pf" Sep 10 17:33:53.551034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:53.550985 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nbdb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Sep 10 17:33:53.551224 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:53.551053 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" podUID="28e4666c-2a88-4f4b-b935-a630c4228a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Sep 10 17:33:53.673670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:53.673624 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:33:54.551096 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:54.551064 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:33:54.551886 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:54.551869 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5" Sep 10 17:33:55.122289 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:33:55.122253 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:34:01.233143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:01.233106 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:34:22.036850 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:22.036772 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:34:31.325062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:31.325019 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:34:38.137661 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:38.137597 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:34:47.698337 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.698304 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98"] Sep 10 17:34:47.701111 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.701090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.704113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.704079 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 10 17:34:47.704272 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.704247 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 17:34:47.704372 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.704349 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 17:34:47.704501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.704425 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hjjt8\"" Sep 10 17:34:47.713843 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.713822 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98"] Sep 10 17:34:47.733282 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.733247 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:34:47.775025 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.775000 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.775132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.775035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.775132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.775075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.775132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.775100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n782j\" (UniqueName: \"kubernetes.io/projected/a73754fb-ab0d-4210-aecb-89774a24177d-kube-api-access-n782j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.775385 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.775195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a73754fb-ab0d-4210-aecb-89774a24177d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.775385 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.775268 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.875938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.875988 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.876029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.876055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n782j\" (UniqueName: \"kubernetes.io/projected/a73754fb-ab0d-4210-aecb-89774a24177d-kube-api-access-n782j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.876108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a73754fb-ab0d-4210-aecb-89774a24177d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.876159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.876535 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.876780 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.880624 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.880552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.881289 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.881244 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a73754fb-ab0d-4210-aecb-89774a24177d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.883270 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.883156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a73754fb-ab0d-4210-aecb-89774a24177d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:47.888510 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:47.888490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n782j\" (UniqueName: \"kubernetes.io/projected/a73754fb-ab0d-4210-aecb-89774a24177d-kube-api-access-n782j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7hf98\" (UID: \"a73754fb-ab0d-4210-aecb-89774a24177d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:48.012917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:48.012898 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:48.284143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:48.284121 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98"] Sep 10 17:34:48.286295 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:34:48.286273 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73754fb_ab0d_4210_aecb_89774a24177d.slice/crio-a44d5dc8a02b7c5f7f2202b0c95c0c3446fd9f8d1bb762e86c43a7403c08a815 WatchSource:0}: Error finding container a44d5dc8a02b7c5f7f2202b0c95c0c3446fd9f8d1bb762e86c43a7403c08a815: Status 404 returned error can't find the container with id a44d5dc8a02b7c5f7f2202b0c95c0c3446fd9f8d1bb762e86c43a7403c08a815 Sep 10 17:34:48.287586 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:48.287569 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:34:48.408222 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:48.408190 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" event={"ID":"a73754fb-ab0d-4210-aecb-89774a24177d","Type":"ContainerStarted","Data":"a44d5dc8a02b7c5f7f2202b0c95c0c3446fd9f8d1bb762e86c43a7403c08a815"} Sep 10 17:34:49.415628 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:49.415589 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" event={"ID":"a73754fb-ab0d-4210-aecb-89774a24177d","Type":"ContainerStarted","Data":"47c9b518e28b9678b9ede5a812a791b57cbc983d3a79af8fe9ad0c352e84d201"} Sep 10 17:34:49.437092 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:49.437038 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" podStartSLOduration=1.48062717 podStartE2EDuration="2.437021935s" totalImagesPullingTime="956.394765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:34:49.434431084 +0000 UTC m=+656.454358237" watchObservedRunningTime="2026-09-10 17:34:49.437021935 +0000 UTC m=+656.456949091" Sep 10 17:34:57.938684 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:57.938625 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:34:58.013373 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:58.013338 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:58.013502 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:58.013388 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:58.025507 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:58.025479 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:34:58.473055 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:34:58.473029 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7hf98" Sep 10 17:35:32.936375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:35:32.936338 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:35:54.848402 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:35:54.848305 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:35:54.937198 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:35:54.937167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:35:55.977117 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:35:55.977070 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:35:56.068400 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:35:56.068369 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:11.858493 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:11.858454 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:11.958863 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:11.958830 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:12.149531 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.149439 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f"] Sep 10 17:36:12.152176 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.152154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.154665 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.154614 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0d25fa-openshift-default-dockercfg-vx8rz\"" Sep 10 17:36:12.169234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.169208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f"] Sep 10 17:36:12.176735 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.176711 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:12.297349 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24ccl\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-kube-api-access-24ccl\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297513 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a837079-d53c-48ed-ac43-c02741bb90ef-istiod-ca-cert\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297513 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-socket\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297513 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-envoy\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297513 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-data\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297678 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-token\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297678 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-podinfo\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297678 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-credential-socket\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.297678 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.297593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-certs\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.357217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.357172 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:12.398218 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-credential-socket\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-certs\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24ccl\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-kube-api-access-24ccl\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398461 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a837079-d53c-48ed-ac43-c02741bb90ef-istiod-ca-cert\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398601 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-socket\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398601 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-envoy\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398601 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-data\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398601 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398568 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-certs\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398855 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-token\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398855 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-podinfo\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-socket\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.398973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.398926 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-data\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.399083 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.399034 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-credential-socket\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.399185 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.399167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a837079-d53c-48ed-ac43-c02741bb90ef-istiod-ca-cert\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.400997 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.400953 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-envoy\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.401307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.401291 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-podinfo\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.406384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.406356 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24ccl\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-kube-api-access-24ccl\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.406384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.406368 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-token\") pod \"e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.463954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.463929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:12.741543 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.741520 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f"] Sep 10 17:36:12.746686 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:36:12.746655 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a837079_d53c_48ed_ac43_c02741bb90ef.slice/crio-3ffa39df5570d046485054913ec915e58d48ba2f5e3a2aa1908e57b0ed8704a5 WatchSource:0}: Error finding container 3ffa39df5570d046485054913ec915e58d48ba2f5e3a2aa1908e57b0ed8704a5: Status 404 returned error can't find the container with id 3ffa39df5570d046485054913ec915e58d48ba2f5e3a2aa1908e57b0ed8704a5 Sep 10 17:36:12.749007 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.748967 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:12.749110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.749058 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:12.749110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.749101 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:12.832710 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.832676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" event={"ID":"5a837079-d53c-48ed-ac43-c02741bb90ef","Type":"ContainerStarted","Data":"1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f"} Sep 10 17:36:12.832907 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.832731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" event={"ID":"5a837079-d53c-48ed-ac43-c02741bb90ef","Type":"ContainerStarted","Data":"3ffa39df5570d046485054913ec915e58d48ba2f5e3a2aa1908e57b0ed8704a5"} Sep 10 17:36:12.887973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:12.887922 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podStartSLOduration=0.887906557 podStartE2EDuration="887.906557ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:36:12.88692694 +0000 UTC m=+739.906854093" watchObservedRunningTime="2026-09-10 17:36:12.887906557 +0000 UTC m=+739.907833708" Sep 10 17:36:13.264267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:13.264218 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:13.338068 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:13.338040 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:13.464527 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:13.464493 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:13.469794 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:13.469772 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:13.713303 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:13.713269 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:13.837958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:13.837930 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:13.838718 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:13.838699 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:14.892976 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:14.892943 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:14.990258 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:14.990221 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:16.068691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.068658 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:16.192219 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.192188 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:16.343512 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.343424 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:16.744694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.744662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:16.842742 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.842711 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:16.896229 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.896200 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k"] Sep 10 17:36:16.898724 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.898709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:16.900848 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.900825 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-0d25fa\"" Sep 10 17:36:16.900963 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.900933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-0d25fa-dockercfg-ccm7k\"" Sep 10 17:36:16.910243 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.910218 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k"] Sep 10 17:36:16.927950 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.927927 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4"] Sep 10 17:36:16.930698 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.930680 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:16.943563 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:16.943540 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4"] Sep 10 17:36:17.036808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.036740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.036939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.036809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbqjz\" (UniqueName: \"kubernetes.io/projected/f989d0fb-348d-405e-81f2-b300f1f7efd3-kube-api-access-xbqjz\") pod \"payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.036939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.036834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7v8p\" (UniqueName: \"kubernetes.io/projected/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-kube-api-access-x7v8p\") pod \"payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.036939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.036885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f989d0fb-348d-405e-81f2-b300f1f7efd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.137716 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.137684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.138153 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.137742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbqjz\" (UniqueName: \"kubernetes.io/projected/f989d0fb-348d-405e-81f2-b300f1f7efd3-kube-api-access-xbqjz\") pod \"payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.138153 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.137866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7v8p\" (UniqueName: \"kubernetes.io/projected/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-kube-api-access-x7v8p\") pod \"payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.138153 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.137964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f989d0fb-348d-405e-81f2-b300f1f7efd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.144955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.138891 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.144955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.139131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f989d0fb-348d-405e-81f2-b300f1f7efd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.148192 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.148159 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7v8p\" (UniqueName: \"kubernetes.io/projected/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-kube-api-access-x7v8p\") pod \"payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.148492 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.148459 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbqjz\" (UniqueName: \"kubernetes.io/projected/f989d0fb-348d-405e-81f2-b300f1f7efd3-kube-api-access-xbqjz\") pod \"payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.209993 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.209969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.239455 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.239425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.492279 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.492231 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k"] Sep 10 17:36:17.494584 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:36:17.494560 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d03794a_89d3_4eda_b1b7_8d541ea8ef7e.slice/crio-c61a6b734b366643cfc93585c1d9839e9c8a89df6747a421c6fdd64d71e40e41 WatchSource:0}: Error finding container c61a6b734b366643cfc93585c1d9839e9c8a89df6747a421c6fdd64d71e40e41: Status 404 returned error can't find the container with id c61a6b734b366643cfc93585c1d9839e9c8a89df6747a421c6fdd64d71e40e41 Sep 10 17:36:17.529541 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.529510 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4"] Sep 10 17:36:17.533998 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:36:17.533966 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf989d0fb_348d_405e_81f2_b300f1f7efd3.slice/crio-3cc5717c2ed6ad9d685688e10572b7b47904410640b0cfd67b73636e76a975da WatchSource:0}: Error finding container 3cc5717c2ed6ad9d685688e10572b7b47904410640b0cfd67b73636e76a975da: Status 404 returned error can't find the container with id 3cc5717c2ed6ad9d685688e10572b7b47904410640b0cfd67b73636e76a975da Sep 10 17:36:17.860195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.860092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" event={"ID":"f989d0fb-348d-405e-81f2-b300f1f7efd3","Type":"ContainerStarted","Data":"9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd"} Sep 10 17:36:17.860195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.860156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" event={"ID":"f989d0fb-348d-405e-81f2-b300f1f7efd3","Type":"ContainerStarted","Data":"3cc5717c2ed6ad9d685688e10572b7b47904410640b0cfd67b73636e76a975da"} Sep 10 17:36:17.860431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.860283 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:17.861739 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.861710 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" event={"ID":"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e","Type":"ContainerStarted","Data":"36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5"} Sep 10 17:36:17.861851 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.861765 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:17.861851 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.861789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" event={"ID":"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e","Type":"ContainerStarted","Data":"c61a6b734b366643cfc93585c1d9839e9c8a89df6747a421c6fdd64d71e40e41"} Sep 10 17:36:17.883891 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.883845 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" podStartSLOduration=1.883829813 podStartE2EDuration="1.883829813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:36:17.881994777 +0000 UTC m=+744.901921930" watchObservedRunningTime="2026-09-10 17:36:17.883829813 +0000 UTC m=+744.903756964" Sep 10 17:36:17.905397 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:17.905345 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" podStartSLOduration=1.9053316489999998 podStartE2EDuration="1.905331649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:36:17.904610487 +0000 UTC m=+744.924537652" watchObservedRunningTime="2026-09-10 17:36:17.905331649 +0000 UTC m=+744.925258809" Sep 10 17:36:19.819334 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:19.819300 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:19.884979 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:19.884946 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:20.040401 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.040367 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:20.313029 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.312998 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f"] Sep 10 17:36:20.315711 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.315678 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.317747 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.317725 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-64df4d9a-openshift-default-dockercfg-lh62l\"" Sep 10 17:36:20.331010 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.330991 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f"] Sep 10 17:36:20.346957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.346923 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:20.439752 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.439729 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:20.469957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.469930 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-data\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470066 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.469958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-token\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470066 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.470024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-envoy\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470066 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.470048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-podinfo\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470188 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.470085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6289de5b-8a4b-485f-91fd-73a5860cb361-istiod-ca-cert\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470188 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.470113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-credential-socket\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470188 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.470159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-certs\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470295 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.470187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5qfs\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-kube-api-access-k5qfs\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.470295 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.470226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-socket\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.571567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-podinfo\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.571567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6289de5b-8a4b-485f-91fd-73a5860cb361-istiod-ca-cert\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.571567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-credential-socket\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.571567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-certs\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.571567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5qfs\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-kube-api-access-k5qfs\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572051 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-socket\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572051 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-data\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572051 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-token\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572051 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.571791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-envoy\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572258 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.572067 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-credential-socket\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572258 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.572239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-data\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572534 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.572329 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-socket\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572534 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.572352 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6289de5b-8a4b-485f-91fd-73a5860cb361-istiod-ca-cert\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.572684 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.572663 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-certs\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.574275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.574250 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-envoy\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.574927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.574905 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-podinfo\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.579826 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.579782 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5qfs\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-kube-api-access-k5qfs\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.579826 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.579807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-token\") pod \"e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.626698 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.626679 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:20.916614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.916585 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f"] Sep 10 17:36:20.919071 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:36:20.919046 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6289de5b_8a4b_485f_91fd_73a5860cb361.slice/crio-2c56343557492d0347d871295f76559f5daad5167b631a3d1f248b1157b76659 WatchSource:0}: Error finding container 2c56343557492d0347d871295f76559f5daad5167b631a3d1f248b1157b76659: Status 404 returned error can't find the container with id 2c56343557492d0347d871295f76559f5daad5167b631a3d1f248b1157b76659 Sep 10 17:36:20.921730 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.921701 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:20.921790 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.921767 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:20.921833 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:20.921815 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:21.884970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:21.884929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" event={"ID":"6289de5b-8a4b-485f-91fd-73a5860cb361","Type":"ContainerStarted","Data":"b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a"} Sep 10 17:36:21.885127 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:21.884993 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" event={"ID":"6289de5b-8a4b-485f-91fd-73a5860cb361","Type":"ContainerStarted","Data":"2c56343557492d0347d871295f76559f5daad5167b631a3d1f248b1157b76659"} Sep 10 17:36:21.907238 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:21.907191 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" podStartSLOduration=1.907175957 podStartE2EDuration="1.907175957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:36:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:36:21.904898792 +0000 UTC m=+748.924825946" watchObservedRunningTime="2026-09-10 17:36:21.907175957 +0000 UTC m=+748.927103109" Sep 10 17:36:22.221180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.221144 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:22.502183 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.502101 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr"] Sep 10 17:36:22.504676 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.504653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.507221 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.507199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-794622-openshift-default-dockercfg-cpqq9\"" Sep 10 17:36:22.517961 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.517939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr"] Sep 10 17:36:22.536502 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.536472 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:22.590565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-podinfo\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590724 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-data\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590724 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5b9d\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-kube-api-access-n5b9d\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-token\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-certs\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590872 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istiod-ca-cert\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590872 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-socket\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590936 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-envoy\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.590970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.590942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-credential-socket\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.627548 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.627528 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:22.632512 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.632495 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:22.692069 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.692034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5b9d\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-kube-api-access-n5b9d\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.692759 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.692730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-token\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.693258 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.693233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-certs\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.693397 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.693379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istiod-ca-cert\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.693521 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.693507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-socket\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.693711 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.693685 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-certs\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.693799 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.693700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-envoy\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.693912 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.693895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-credential-socket\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.694336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.694187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-podinfo\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.694336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.694229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-data\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.694336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.694271 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-socket\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.694336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.694323 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-credential-socket\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.694604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.694562 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-data\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.694779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.694755 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istiod-ca-cert\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.697332 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.697288 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-envoy\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.699738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.699707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-podinfo\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.703173 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.703149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-token\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.703453 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.703436 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5b9d\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-kube-api-access-n5b9d\") pod \"e2e-autores-794622-openshift-default-846d6d74-v8xsr\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.815860 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.815804 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:22.891481 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.891415 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:22.892911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:22.892889 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:23.021996 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.021969 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:23.096286 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.096257 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr"] Sep 10 17:36:23.097616 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:36:23.097587 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08f751e_b914_48a0_99d8_4a4cfc8ca8fc.slice/crio-cee2b051e07d649f03a01f80a0ea4f480f79a9bc81835b93698c63e77ad0cfb8 WatchSource:0}: Error finding container cee2b051e07d649f03a01f80a0ea4f480f79a9bc81835b93698c63e77ad0cfb8: Status 404 returned error can't find the container with id cee2b051e07d649f03a01f80a0ea4f480f79a9bc81835b93698c63e77ad0cfb8 Sep 10 17:36:23.099878 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.099846 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:23.099981 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.099909 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:23.099981 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.099962 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:23.309547 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.309502 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:23.405863 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.405780 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:23.897816 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.897781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" event={"ID":"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc","Type":"ContainerStarted","Data":"710de9de3c70a154a1c5235a38cfba5373b3d8a124a4f48c1ebb3da2cd67b6f7"} Sep 10 17:36:23.898012 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.897828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" event={"ID":"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc","Type":"ContainerStarted","Data":"cee2b051e07d649f03a01f80a0ea4f480f79a9bc81835b93698c63e77ad0cfb8"} Sep 10 17:36:23.919167 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:23.919125 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podStartSLOduration=1.919109304 podStartE2EDuration="1.919109304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:36:23.918101441 +0000 UTC m=+750.938028618" watchObservedRunningTime="2026-09-10 17:36:23.919109304 +0000 UTC m=+750.939036455" Sep 10 17:36:24.656727 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:24.656689 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:24.752666 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:24.749554 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:24.816109 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:24.816077 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:24.821112 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:24.821087 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:24.847592 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:24.847546 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:24.903860 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:24.903820 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:24.904767 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:24.904742 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:25.151736 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:25.151692 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:25.252386 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:25.252355 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:25.904452 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:25.904413 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:25.987677 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:25.987614 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:27.152416 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.152374 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:27.254242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.254199 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:27.416825 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.416740 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:27.641282 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.641253 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:27.741847 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.741819 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:27.801349 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.801317 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf"] Sep 10 17:36:27.804340 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.804323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:27.807119 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.807098 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-794622-dockercfg-8k85q\"" Sep 10 17:36:27.807404 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.807372 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-794622\"" Sep 10 17:36:27.887692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.887658 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf"] Sep 10 17:36:27.960951 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.960914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bf2h\" (UniqueName: \"kubernetes.io/projected/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-kube-api-access-2bf2h\") pod \"payload-processing-e2e-autores-794622-b6745797-2s8kf\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:27.961121 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:27.960978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-plugins-config-volume\") pod \"payload-processing-e2e-autores-794622-b6745797-2s8kf\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:28.062532 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.062448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bf2h\" (UniqueName: \"kubernetes.io/projected/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-kube-api-access-2bf2h\") pod \"payload-processing-e2e-autores-794622-b6745797-2s8kf\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:28.062532 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.062521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-plugins-config-volume\") pod \"payload-processing-e2e-autores-794622-b6745797-2s8kf\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:28.063240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.063221 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-plugins-config-volume\") pod \"payload-processing-e2e-autores-794622-b6745797-2s8kf\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:28.072067 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.072045 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bf2h\" (UniqueName: \"kubernetes.io/projected/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-kube-api-access-2bf2h\") pod \"payload-processing-e2e-autores-794622-b6745797-2s8kf\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:28.114867 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.114841 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:28.405136 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.405110 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf"] Sep 10 17:36:28.406757 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:36:28.406730 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4c006a_eda9_45ab_ab1d_f6cc31d5c389.slice/crio-de6f5947d71368fa32f7f83761c308e63357200375b51e7b2ae5ff90f1f53993 WatchSource:0}: Error finding container de6f5947d71368fa32f7f83761c308e63357200375b51e7b2ae5ff90f1f53993: Status 404 returned error can't find the container with id de6f5947d71368fa32f7f83761c308e63357200375b51e7b2ae5ff90f1f53993 Sep 10 17:36:28.868694 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.868623 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:36:28.868858 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.868847 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:36:28.936392 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.936359 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" event={"ID":"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389","Type":"ContainerStarted","Data":"77abaf11f3678c6f079b499066b7a05e28929164b577271b78fb6d94bb01d436"} Sep 10 17:36:28.936731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.936699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" event={"ID":"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389","Type":"ContainerStarted","Data":"de6f5947d71368fa32f7f83761c308e63357200375b51e7b2ae5ff90f1f53993"} Sep 10 17:36:28.937895 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.937878 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:28.965666 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:28.961207 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" podStartSLOduration=1.961186179 podStartE2EDuration="1.961186179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:36:28.957506008 +0000 UTC m=+755.977433161" watchObservedRunningTime="2026-09-10 17:36:28.961186179 +0000 UTC m=+755.981113334" Sep 10 17:36:32.459224 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.459197 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:32.626662 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.626605 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:32.721270 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.721210 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:32.821083 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.821037 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:32.961210 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.961181 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerID="1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f" exitCode=0 Sep 10 17:36:32.961412 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.961260 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" event={"ID":"5a837079-d53c-48ed-ac43-c02741bb90ef","Type":"ContainerDied","Data":"1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f"} Sep 10 17:36:32.961799 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.961780 2580 scope.go:117] "RemoveContainer" containerID="1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f" Sep 10 17:36:32.963103 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.963073 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:32.963187 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.963153 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:32.963234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:32.963187 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:33.969166 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:33.969130 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" event={"ID":"5a837079-d53c-48ed-ac43-c02741bb90ef","Type":"ContainerStarted","Data":"057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5"} Sep 10 17:36:34.465315 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:34.465264 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:34.465533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:34.465445 2580 patch_prober.go:28] interesting pod/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Sep 10 17:36:34.465533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:34.465488 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Sep 10 17:36:35.465267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:35.465224 2580 patch_prober.go:28] interesting pod/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Sep 10 17:36:35.465764 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:35.465293 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Sep 10 17:36:35.502110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:35.502070 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:36.464867 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:36.464817 2580 patch_prober.go:28] interesting pod/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Sep 10 17:36:36.465092 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:36.464899 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Sep 10 17:36:37.164825 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:37.164789 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:37.279664 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:37.269097 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:37.413825 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:37.413782 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:37.464777 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:37.464738 2580 patch_prober.go:28] interesting pod/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Sep 10 17:36:37.464994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:37.464814 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Sep 10 17:36:38.226255 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:38.226222 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:38.465257 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:38.465220 2580 patch_prober.go:28] interesting pod/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Sep 10 17:36:38.465461 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:38.465284 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Sep 10 17:36:39.464606 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:39.464568 2580 patch_prober.go:28] interesting pod/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Sep 10 17:36:39.465222 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:39.465188 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Sep 10 17:36:39.703983 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:39.703950 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:40.002186 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.002150 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:40.298160 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.298129 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:40.469826 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.469791 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:40.470265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.470214 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:40.470906 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.470880 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:36:40.843081 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.843043 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:40.945832 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.945787 2580 patch_prober.go:28] interesting pod/e2e-autores-794622-openshift-default-846d6d74-v8xsr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 10 17:36:40.946040 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.945875 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 10 17:36:40.950166 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:40.950129 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:36:43.048845 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.048815 2580 generic.go:356] "Generic (PLEG): container finished" podID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerID="b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a" exitCode=0 Sep 10 17:36:43.049275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.048900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" event={"ID":"6289de5b-8a4b-485f-91fd-73a5860cb361","Type":"ContainerDied","Data":"b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a"} Sep 10 17:36:43.049396 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.049379 2580 scope.go:117] "RemoveContainer" containerID="b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a" Sep 10 17:36:43.050498 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.050465 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:43.050582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.050539 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:43.050629 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.050584 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:43.050756 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.050739 2580 generic.go:356] "Generic (PLEG): container finished" podID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerID="710de9de3c70a154a1c5235a38cfba5373b3d8a124a4f48c1ebb3da2cd67b6f7" exitCode=0 Sep 10 17:36:43.050810 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.050798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" event={"ID":"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc","Type":"ContainerDied","Data":"710de9de3c70a154a1c5235a38cfba5373b3d8a124a4f48c1ebb3da2cd67b6f7"} Sep 10 17:36:43.051138 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.051123 2580 scope.go:117] "RemoveContainer" containerID="710de9de3c70a154a1c5235a38cfba5373b3d8a124a4f48c1ebb3da2cd67b6f7" Sep 10 17:36:43.052140 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.052118 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:43.052211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.052173 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:43.052211 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.052205 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:36:43.307900 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.307804 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:43.423845 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.423813 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:43.513375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.513343 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:43.635866 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:43.635793 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:44.064322 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.064287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" event={"ID":"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc","Type":"ContainerStarted","Data":"48017a20ddf4ed05b56826cb79830202249b7a8733add1d078b8ac154cf9625e"} Sep 10 17:36:44.068055 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.068028 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" event={"ID":"6289de5b-8a4b-485f-91fd-73a5860cb361","Type":"ContainerStarted","Data":"c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d"} Sep 10 17:36:44.627894 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.627857 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:44.628250 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.628226 2580 patch_prober.go:28] interesting pod/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Sep 10 17:36:44.628409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.628384 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Sep 10 17:36:44.816619 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.816585 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:44.817023 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.816997 2580 patch_prober.go:28] interesting pod/e2e-autores-794622-openshift-default-846d6d74-v8xsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Sep 10 17:36:44.817140 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:44.817052 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Sep 10 17:36:45.582667 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:45.582191 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:45.634464 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:45.634426 2580 patch_prober.go:28] interesting pod/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Sep 10 17:36:45.634776 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:45.634733 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Sep 10 17:36:45.716850 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:45.716799 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:45.816999 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:45.816969 2580 patch_prober.go:28] interesting pod/e2e-autores-794622-openshift-default-846d6d74-v8xsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Sep 10 17:36:45.817228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:45.817205 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Sep 10 17:36:46.483896 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:46.483852 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:46.587508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:46.587482 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:46.627711 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:46.627679 2580 patch_prober.go:28] interesting pod/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Sep 10 17:36:46.627950 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:46.627921 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Sep 10 17:36:46.816747 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:46.816674 2580 patch_prober.go:28] interesting pod/e2e-autores-794622-openshift-default-846d6d74-v8xsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Sep 10 17:36:46.816960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:46.816939 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Sep 10 17:36:47.627184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:47.627135 2580 patch_prober.go:28] interesting pod/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Sep 10 17:36:47.627794 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:47.627750 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Sep 10 17:36:47.812406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:47.812377 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:47.816476 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:47.816450 2580 patch_prober.go:28] interesting pod/e2e-autores-794622-openshift-default-846d6d74-v8xsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Sep 10 17:36:47.816680 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:47.816658 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Sep 10 17:36:47.917793 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:47.917708 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:48.015247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.015210 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:48.349664 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.349614 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:48.450667 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.447362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:48.484596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.484553 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97"] Sep 10 17:36:48.487300 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.487277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.489695 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.489674 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2f1093\"" Sep 10 17:36:48.489826 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.489731 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-2f1093-dockercfg-nv9kc\"" Sep 10 17:36:48.496064 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.496028 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97"] Sep 10 17:36:48.608243 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.608144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d230c2-1d67-4a64-8756-4462519b2d7c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.608654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.608611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jbcw\" (UniqueName: \"kubernetes.io/projected/88d230c2-1d67-4a64-8756-4462519b2d7c-kube-api-access-8jbcw\") pod \"payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.628062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.628025 2580 patch_prober.go:28] interesting pod/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Sep 10 17:36:48.628604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.628574 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Sep 10 17:36:48.710281 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.710243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jbcw\" (UniqueName: \"kubernetes.io/projected/88d230c2-1d67-4a64-8756-4462519b2d7c-kube-api-access-8jbcw\") pod \"payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.710799 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.710775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d230c2-1d67-4a64-8756-4462519b2d7c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.711479 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.711441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d230c2-1d67-4a64-8756-4462519b2d7c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.719766 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.719746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jbcw\" (UniqueName: \"kubernetes.io/projected/88d230c2-1d67-4a64-8756-4462519b2d7c-kube-api-access-8jbcw\") pod \"payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.799498 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.799471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:48.816676 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.816620 2580 patch_prober.go:28] interesting pod/e2e-autores-794622-openshift-default-846d6d74-v8xsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Sep 10 17:36:48.816779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:48.816712 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Sep 10 17:36:49.141139 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.129843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97"] Sep 10 17:36:49.560578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.560532 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:49.681007 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.680958 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:49.682084 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.682057 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:49.683595 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.683577 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:36:49.820226 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.820147 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:49.820604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.820589 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:49.821289 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:49.821268 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:36:50.107259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:50.107168 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" event={"ID":"88d230c2-1d67-4a64-8756-4462519b2d7c","Type":"ContainerStarted","Data":"0c7a08f084d681d6d484a90c85dd55ab91488ff6b9406bc38ae45651f8cd60ea"} Sep 10 17:36:50.107259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:50.107227 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" event={"ID":"88d230c2-1d67-4a64-8756-4462519b2d7c","Type":"ContainerStarted","Data":"233b21b8861d391b052e800797df2a34aebf7441eebbb214c64cb476b2bf7174"} Sep 10 17:36:50.142168 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:50.142106 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" podStartSLOduration=2.14208785 podStartE2EDuration="2.14208785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:36:50.140223452 +0000 UTC m=+777.160150606" watchObservedRunningTime="2026-09-10 17:36:50.14208785 +0000 UTC m=+777.162015003" Sep 10 17:36:50.566449 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:50.566398 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:51.078723 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:51.078688 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:51.112505 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:51.112483 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:36:51.178795 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:51.178769 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:36:55.817305 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:36:55.817267 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:02.120533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:02.120504 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:37:04.945249 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:04.945220 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:05.560609 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:05.560573 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:05.660822 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:05.660788 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:05.761069 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:05.761037 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:05.832842 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:05.832765 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:05.901407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:05.901374 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f"] Sep 10 17:37:05.901622 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:05.901597 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" containerID="cri-o://c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d" gracePeriod=30 Sep 10 17:37:05.931907 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:05.931875 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:06.373934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:06.373901 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:06.574025 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:06.573995 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:06.695691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:06.695599 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:06.914145 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:06.914113 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:08.187212 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:08.187178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:08.824034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:08.824000 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:09.145253 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:09.145170 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:09.243041 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:09.243012 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:09.779333 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:09.779305 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:09.879282 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:09.879247 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:09.978923 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:09.978887 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:10.385852 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:10.385807 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:10.482224 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:10.482196 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:10.958581 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:10.958558 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:11.154811 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.154786 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:37:11.224284 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.224254 2580 generic.go:356] "Generic (PLEG): container finished" podID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerID="c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d" exitCode=0 Sep 10 17:37:11.224443 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.224307 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" Sep 10 17:37:11.224443 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.224342 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" event={"ID":"6289de5b-8a4b-485f-91fd-73a5860cb361","Type":"ContainerDied","Data":"c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d"} Sep 10 17:37:11.224443 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.224402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f" event={"ID":"6289de5b-8a4b-485f-91fd-73a5860cb361","Type":"ContainerDied","Data":"2c56343557492d0347d871295f76559f5daad5167b631a3d1f248b1157b76659"} Sep 10 17:37:11.224443 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.224434 2580 scope.go:117] "RemoveContainer" containerID="c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d" Sep 10 17:37:11.234361 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.234332 2580 scope.go:117] "RemoveContainer" containerID="b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a" Sep 10 17:37:11.242972 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.242953 2580 scope.go:117] "RemoveContainer" containerID="c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d" Sep 10 17:37:11.243221 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:37:11.243201 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d\": container with ID starting with c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d not found: ID does not exist" containerID="c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d" Sep 10 17:37:11.243281 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.243230 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d"} err="failed to get container status \"c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d\": rpc error: code = NotFound desc = could not find container \"c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d\": container with ID starting with c3b91f2c238bf6f5f4750afd38baa5ec4690f6b8f12b90060f84640e4bfad06d not found: ID does not exist" Sep 10 17:37:11.243281 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.243246 2580 scope.go:117] "RemoveContainer" containerID="b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a" Sep 10 17:37:11.243486 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:37:11.243472 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a\": container with ID starting with b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a not found: ID does not exist" containerID="b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a" Sep 10 17:37:11.243531 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.243491 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a"} err="failed to get container status \"b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a\": rpc error: code = NotFound desc = could not find container \"b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a\": container with ID starting with b0096a805e2f878d4fa08a845fde2809720ce0fb158b13d18f382d277cf6260a not found: ID does not exist" Sep 10 17:37:11.317612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317588 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-credential-socket\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.317731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317618 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-token\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.317731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317680 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-certs\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.317731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317700 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-data\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.317864 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317772 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-podinfo\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.317864 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317797 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-socket\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.317864 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317808 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:37:11.318017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317877 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-envoy\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.318017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317925 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6289de5b-8a4b-485f-91fd-73a5860cb361-istiod-ca-cert\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.318017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317964 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5qfs\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-kube-api-access-k5qfs\") pod \"6289de5b-8a4b-485f-91fd-73a5860cb361\" (UID: \"6289de5b-8a4b-485f-91fd-73a5860cb361\") " Sep 10 17:37:11.318178 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.317954 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:37:11.318178 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.318066 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-data" (OuterVolumeSpecName: "istio-data") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:37:11.318296 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.318177 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:37:11.318296 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.318277 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289de5b-8a4b-485f-91fd-73a5860cb361-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:37:11.318406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.318357 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.318406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.318375 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.318406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.318383 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.318406 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.318391 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.319985 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.319963 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-token" (OuterVolumeSpecName: "istio-token") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:37:11.320102 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.319985 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:37:11.320568 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.320546 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-kube-api-access-k5qfs" (OuterVolumeSpecName: "kube-api-access-k5qfs") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "kube-api-access-k5qfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:37:11.320568 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.320548 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6289de5b-8a4b-485f-91fd-73a5860cb361" (UID: "6289de5b-8a4b-485f-91fd-73a5860cb361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:37:11.344793 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.344769 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:11.419158 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.419131 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.419158 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.419159 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.419517 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.419172 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6289de5b-8a4b-485f-91fd-73a5860cb361-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.419517 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.419183 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5qfs\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-kube-api-access-k5qfs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.419517 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.419195 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6289de5b-8a4b-485f-91fd-73a5860cb361-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:37:11.556568 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.556502 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f"] Sep 10 17:37:11.562090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.562063 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f"] Sep 10 17:37:11.827483 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:11.827401 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:13.431495 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:13.431461 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" path="/var/lib/kubelet/pods/6289de5b-8a4b-485f-91fd-73a5860cb361/volumes" Sep 10 17:37:35.847223 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:35.847175 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:40.712188 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:40.712039 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:40.779002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:40.778969 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:40.842277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:40.842246 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:40.909062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:40.909035 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:40.973495 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:40.973419 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:41.054547 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.054517 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:41.502444 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.502403 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:41.797419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.797349 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464"] Sep 10 17:37:41.797804 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.797771 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" Sep 10 17:37:41.797804 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.797784 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" Sep 10 17:37:41.797804 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.797792 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" Sep 10 17:37:41.797804 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.797800 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" Sep 10 17:37:41.797937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.797878 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" Sep 10 17:37:41.797937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.797889 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289de5b-8a4b-485f-91fd-73a5860cb361" containerName="istio-proxy" Sep 10 17:37:41.800213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.800197 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.802566 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.802543 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b0b7bb86-openshift-default-dockercfg-rf2nw\"" Sep 10 17:37:41.816243 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.816220 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464"] Sep 10 17:37:41.826822 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.826799 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:41.879195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-envoy\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-token\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-socket\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879462 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879265 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-podinfo\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879462 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-credential-socket\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879462 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24jd7\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-kube-api-access-24jd7\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879462 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-data\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879462 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istiod-ca-cert\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.879462 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.879446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-certs\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980208 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-socket\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-podinfo\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-credential-socket\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24jd7\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-kube-api-access-24jd7\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-data\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980626 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980438 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istiod-ca-cert\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980626 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-socket\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980770 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980670 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-credential-socket\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980829 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-data\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980882 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-certs\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.980943 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980916 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-envoy\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.981000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.980957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-token\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.981190 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.981162 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-certs\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.981292 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.981249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istiod-ca-cert\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.983261 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.983230 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-envoy\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.983487 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.983465 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-podinfo\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.990916 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.990890 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24jd7\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-kube-api-access-24jd7\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:41.991239 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:41.991222 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-token\") pod \"e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:42.024929 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:42.024897 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:42.110117 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:42.110031 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:42.392509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:42.392480 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464"] Sep 10 17:37:42.394386 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:37:42.394363 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a86ab8_1ea7_4e2c_b0f5_35189f4b75c4.slice/crio-fd9f23529642a9cbc4096a31704c31e695eda6948fc865660d73fbc21d8b5326 WatchSource:0}: Error finding container fd9f23529642a9cbc4096a31704c31e695eda6948fc865660d73fbc21d8b5326: Status 404 returned error can't find the container with id fd9f23529642a9cbc4096a31704c31e695eda6948fc865660d73fbc21d8b5326 Sep 10 17:37:42.396616 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:42.396585 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:37:42.396698 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:42.396667 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:37:42.396745 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:42.396697 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:37:42.406334 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:42.406312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" event={"ID":"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4","Type":"ContainerStarted","Data":"fd9f23529642a9cbc4096a31704c31e695eda6948fc865660d73fbc21d8b5326"} Sep 10 17:37:43.413764 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:43.413727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" event={"ID":"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4","Type":"ContainerStarted","Data":"a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730"} Sep 10 17:37:43.434714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:43.434665 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" podStartSLOduration=2.434629921 podStartE2EDuration="2.434629921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:37:43.432594075 +0000 UTC m=+830.452521229" watchObservedRunningTime="2026-09-10 17:37:43.434629921 +0000 UTC m=+830.454557073" Sep 10 17:37:44.110387 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:44.110354 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:44.115363 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:44.115341 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:44.423004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:44.422929 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:44.423866 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:44.423847 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:37:44.783995 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:44.783965 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:44.880707 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:44.880666 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:46.003555 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:46.003521 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:46.068952 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:46.068461 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:46.396225 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:46.396153 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:46.496363 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:46.496332 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:46.581405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:46.581383 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:37:57.818254 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:37:57.818216 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:03.528577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:03.528548 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerID="a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730" exitCode=0 Sep 10 17:38:03.528960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:03.528620 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" event={"ID":"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4","Type":"ContainerDied","Data":"a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730"} Sep 10 17:38:03.529004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:03.528974 2580 scope.go:117] "RemoveContainer" containerID="a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730" Sep 10 17:38:03.530169 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:03.530143 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:38:03.530240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:03.530225 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:38:03.530275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:03.530261 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:38:04.550170 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:04.550120 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" event={"ID":"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4","Type":"ContainerStarted","Data":"396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967"} Sep 10 17:38:05.110720 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:05.110689 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:38:05.110884 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:05.110845 2580 patch_prober.go:28] interesting pod/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 10 17:38:05.110932 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:05.110894 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 10 17:38:06.110660 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:06.110605 2580 patch_prober.go:28] interesting pod/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 10 17:38:06.111040 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:06.110693 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 10 17:38:06.744265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:06.744189 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:07.111150 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:07.111062 2580 patch_prober.go:28] interesting pod/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 10 17:38:07.111516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:07.111142 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 10 17:38:08.111549 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:08.111509 2580 patch_prober.go:28] interesting pod/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 10 17:38:08.112194 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:08.111608 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 10 17:38:09.111360 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:09.111331 2580 patch_prober.go:28] interesting pod/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 10 17:38:09.111529 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:09.111379 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 10 17:38:10.115155 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:10.115126 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:38:10.115626 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:10.115540 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:38:10.116447 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:10.116426 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:38:16.433128 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:16.433094 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:16.533292 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:16.533259 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:16.614997 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:16.614968 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:16.678543 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:16.678500 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:17.690479 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:17.690446 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464"] Sep 10 17:38:17.690932 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:17.690669 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" containerID="cri-o://396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967" gracePeriod=30 Sep 10 17:38:17.722336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:17.722312 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:18.156962 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:18.156931 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:18.448434 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:18.448355 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:18.566123 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:18.566095 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:21.443873 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:21.443839 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:21.534305 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:21.534276 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:22.200368 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.200339 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:22.598422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.598344 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:22.709538 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.709507 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:22.948533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.948509 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:38:22.949629 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949611 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24jd7\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-kube-api-access-24jd7\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949704 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-token\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949728 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-socket\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949819 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949752 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-podinfo\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949819 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949791 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-envoy\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949897 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949833 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-certs\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949897 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949865 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istiod-ca-cert\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949899 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-credential-socket\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.949994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.949946 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-data\") pod \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\" (UID: \"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4\") " Sep 10 17:38:22.950100 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950047 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:22.950265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950239 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:22.950350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950281 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:38:22.950410 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950373 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:22.950523 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950479 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:22.950523 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950504 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:22.950713 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950526 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:22.950713 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.950560 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:22.952164 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.952143 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:22.952280 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.952164 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:38:22.952454 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.952429 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:38:22.952454 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:22.952438 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-kube-api-access-24jd7" (OuterVolumeSpecName: "kube-api-access-24jd7") pod "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" (UID: "f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4"). InnerVolumeSpecName "kube-api-access-24jd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:38:23.051569 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.051540 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:23.051569 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.051566 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:23.051569 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.051575 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:23.051779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.051582 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:23.051779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.051590 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24jd7\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-kube-api-access-24jd7\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:23.051779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.051599 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:23.124346 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.124270 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:23.225582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.225551 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:23.659796 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.659764 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerID="396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967" exitCode=0 Sep 10 17:38:23.660143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.659830 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" Sep 10 17:38:23.660143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.659845 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" event={"ID":"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4","Type":"ContainerDied","Data":"396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967"} Sep 10 17:38:23.660143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.659896 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464" event={"ID":"f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4","Type":"ContainerDied","Data":"fd9f23529642a9cbc4096a31704c31e695eda6948fc865660d73fbc21d8b5326"} Sep 10 17:38:23.660143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.659919 2580 scope.go:117] "RemoveContainer" containerID="396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967" Sep 10 17:38:23.669306 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.669288 2580 scope.go:117] "RemoveContainer" containerID="a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730" Sep 10 17:38:23.676795 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.676771 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464"] Sep 10 17:38:23.679171 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.679145 2580 scope.go:117] "RemoveContainer" containerID="396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967" Sep 10 17:38:23.679464 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:38:23.679442 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967\": container with ID starting with 396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967 not found: ID does not exist" containerID="396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967" Sep 10 17:38:23.679576 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.679470 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967"} err="failed to get container status \"396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967\": rpc error: code = NotFound desc = could not find container \"396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967\": container with ID starting with 396c8f8c0a61fa3a64182f67ffc54d9ce5aeacf2bde9518335880efaec12d967 not found: ID does not exist" Sep 10 17:38:23.679576 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.679488 2580 scope.go:117] "RemoveContainer" containerID="a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730" Sep 10 17:38:23.679828 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.679808 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464"] Sep 10 17:38:23.679828 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:38:23.679813 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730\": container with ID starting with a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730 not found: ID does not exist" containerID="a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730" Sep 10 17:38:23.679957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:23.679843 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730"} err="failed to get container status \"a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730\": rpc error: code = NotFound desc = could not find container \"a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730\": container with ID starting with a2c382f5d6dbc3afe0484f21cba212f1c5d39a128457afcf9eb8996be4f0c730 not found: ID does not exist" Sep 10 17:38:25.398606 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:25.398577 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:25.432268 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:25.432239 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" path="/var/lib/kubelet/pods/f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4/volumes" Sep 10 17:38:27.408262 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:27.408228 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:33.013415 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:33.013382 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:33.237824 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:33.237792 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:43.038327 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:43.038291 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:43.935475 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:43.935441 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:44.589421 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.589339 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:44.616206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.616178 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf"] Sep 10 17:38:44.616427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.616404 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" podUID="bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" containerName="payload-processing" containerID="cri-o://77abaf11f3678c6f079b499066b7a05e28929164b577271b78fb6d94bb01d436" gracePeriod=30 Sep 10 17:38:44.657995 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.657969 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:44.725780 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.725748 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:44.781031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.780999 2580 generic.go:356] "Generic (PLEG): container finished" podID="bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" containerID="77abaf11f3678c6f079b499066b7a05e28929164b577271b78fb6d94bb01d436" exitCode=0 Sep 10 17:38:44.781177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.781055 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" event={"ID":"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389","Type":"ContainerDied","Data":"77abaf11f3678c6f079b499066b7a05e28929164b577271b78fb6d94bb01d436"} Sep 10 17:38:44.814337 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.814309 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:44.864420 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.864400 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:38:44.877081 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.877002 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:44.947305 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.947279 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-plugins-config-volume\") pod \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " Sep 10 17:38:44.947469 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.947321 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bf2h\" (UniqueName: \"kubernetes.io/projected/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-kube-api-access-2bf2h\") pod \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\" (UID: \"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389\") " Sep 10 17:38:44.947675 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.947624 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" (UID: "bb4c006a-eda9-45ab-ab1d-f6cc31d5c389"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:38:44.949590 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:44.949564 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-kube-api-access-2bf2h" (OuterVolumeSpecName: "kube-api-access-2bf2h") pod "bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" (UID: "bb4c006a-eda9-45ab-ab1d-f6cc31d5c389"). InnerVolumeSpecName "kube-api-access-2bf2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:38:45.048086 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.048056 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:45.048086 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.048084 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bf2h\" (UniqueName: \"kubernetes.io/projected/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389-kube-api-access-2bf2h\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:45.164958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.164889 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:45.787526 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.787494 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" event={"ID":"bb4c006a-eda9-45ab-ab1d-f6cc31d5c389","Type":"ContainerDied","Data":"de6f5947d71368fa32f7f83761c308e63357200375b51e7b2ae5ff90f1f53993"} Sep 10 17:38:45.787953 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.787535 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf" Sep 10 17:38:45.787953 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.787578 2580 scope.go:117] "RemoveContainer" containerID="77abaf11f3678c6f079b499066b7a05e28929164b577271b78fb6d94bb01d436" Sep 10 17:38:45.811367 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.811343 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf"] Sep 10 17:38:45.816359 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:45.816334 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf"] Sep 10 17:38:47.432304 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:47.432276 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" path="/var/lib/kubelet/pods/bb4c006a-eda9-45ab-ab1d-f6cc31d5c389/volumes" Sep 10 17:38:51.362692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:51.362662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:51.462972 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:51.462944 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:51.608732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:51.608697 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr"] Sep 10 17:38:51.608970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:51.608924 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" containerID="cri-o://48017a20ddf4ed05b56826cb79830202249b7a8733add1d078b8ac154cf9625e" gracePeriod=30 Sep 10 17:38:51.642423 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:51.642361 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:52.113577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:52.113539 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:52.429384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:52.429286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:53.266612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:53.266577 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:53.369868 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:53.369835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:53.467300 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:53.467271 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:53.571570 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:53.568691 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:53.660577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:53.660543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:54.382330 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:54.382294 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:54.479893 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:54.479863 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:54.582517 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:54.582481 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:55.480631 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:55.480592 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:55.576487 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:55.576449 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:55.937054 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:55.936965 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:56.636754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.636703 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:56.737761 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.737732 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:56.867501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.867469 2580 generic.go:356] "Generic (PLEG): container finished" podID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerID="48017a20ddf4ed05b56826cb79830202249b7a8733add1d078b8ac154cf9625e" exitCode=0 Sep 10 17:38:56.867713 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.867687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" event={"ID":"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc","Type":"ContainerDied","Data":"48017a20ddf4ed05b56826cb79830202249b7a8733add1d078b8ac154cf9625e"} Sep 10 17:38:56.867824 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.867807 2580 scope.go:117] "RemoveContainer" containerID="710de9de3c70a154a1c5235a38cfba5373b3d8a124a4f48c1ebb3da2cd67b6f7" Sep 10 17:38:56.885419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.885399 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:38:56.952734 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952696 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-socket\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.952905 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952748 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-envoy\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.952905 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952800 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istiod-ca-cert\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.952905 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952839 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-token\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.952905 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952868 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-credential-socket\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.952905 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952900 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-data\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.953180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952955 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-certs\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.953180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.952993 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:56.953180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953045 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-podinfo\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.953180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953083 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5b9d\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-kube-api-access-n5b9d\") pod \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\" (UID: \"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc\") " Sep 10 17:38:56.953386 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953226 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:56.953386 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953241 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:56.953386 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953344 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:56.953539 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953482 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:56.953539 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953502 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:56.953672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953547 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:56.953672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953563 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:56.953672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.953502 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:38:56.955909 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.955868 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:38:56.955909 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.955888 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:38:56.956054 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.956032 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-kube-api-access-n5b9d" (OuterVolumeSpecName: "kube-api-access-n5b9d") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "kube-api-access-n5b9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:38:56.956096 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:56.956083 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" (UID: "c08f751e-b914-48a0-99d8-4a4cfc8ca8fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:38:57.055082 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.055043 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:57.055082 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.055080 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5b9d\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-kube-api-access-n5b9d\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:57.055082 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.055091 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:57.055303 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.055100 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:57.055303 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.055108 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:38:57.141895 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.141804 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:57.234629 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.234598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:57.271008 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.270927 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc"] Sep 10 17:38:57.271375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271360 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" Sep 10 17:38:57.271424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271378 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" Sep 10 17:38:57.271424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271390 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" containerName="payload-processing" Sep 10 17:38:57.271424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271395 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" containerName="payload-processing" Sep 10 17:38:57.271424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271414 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" Sep 10 17:38:57.271424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271419 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" Sep 10 17:38:57.271574 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271473 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" Sep 10 17:38:57.271574 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271482 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" Sep 10 17:38:57.271574 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.271491 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb4c006a-eda9-45ab-ab1d-f6cc31d5c389" containerName="payload-processing" Sep 10 17:38:57.274377 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.274361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.277965 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.277946 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-14b3e7\"" Sep 10 17:38:57.282792 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.282776 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-14b3e7-dockercfg-2jsfr\"" Sep 10 17:38:57.290714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.290690 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc"] Sep 10 17:38:57.331345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.331308 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:38:57.358241 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.358199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21357811-694f-4a8a-a714-fe6c4292e89b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.358422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.358333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bbd5\" (UniqueName: \"kubernetes.io/projected/21357811-694f-4a8a-a714-fe6c4292e89b-kube-api-access-8bbd5\") pod \"payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.459518 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.459475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21357811-694f-4a8a-a714-fe6c4292e89b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.459728 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.459561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bbd5\" (UniqueName: \"kubernetes.io/projected/21357811-694f-4a8a-a714-fe6c4292e89b-kube-api-access-8bbd5\") pod \"payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.460212 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.460186 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21357811-694f-4a8a-a714-fe6c4292e89b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.467375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.467347 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bbd5\" (UniqueName: \"kubernetes.io/projected/21357811-694f-4a8a-a714-fe6c4292e89b-kube-api-access-8bbd5\") pod \"payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.584485 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.584443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:57.869395 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.869364 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc"] Sep 10 17:38:57.872517 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:38:57.872489 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21357811_694f_4a8a_a714_fe6c4292e89b.slice/crio-9a8561de832e65d8f8305272c74643dde59ecaaf44c84a1204c90a5398a191bf WatchSource:0}: Error finding container 9a8561de832e65d8f8305272c74643dde59ecaaf44c84a1204c90a5398a191bf: Status 404 returned error can't find the container with id 9a8561de832e65d8f8305272c74643dde59ecaaf44c84a1204c90a5398a191bf Sep 10 17:38:57.876341 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.876313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" event={"ID":"c08f751e-b914-48a0-99d8-4a4cfc8ca8fc","Type":"ContainerDied","Data":"cee2b051e07d649f03a01f80a0ea4f480f79a9bc81835b93698c63e77ad0cfb8"} Sep 10 17:38:57.876501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.876375 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr" Sep 10 17:38:57.876501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.876381 2580 scope.go:117] "RemoveContainer" containerID="48017a20ddf4ed05b56826cb79830202249b7a8733add1d078b8ac154cf9625e" Sep 10 17:38:57.908953 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.908926 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr"] Sep 10 17:38:57.915311 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:57.915286 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr"] Sep 10 17:38:58.885972 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:58.885939 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" event={"ID":"21357811-694f-4a8a-a714-fe6c4292e89b","Type":"ContainerStarted","Data":"826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0"} Sep 10 17:38:58.886431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:58.885984 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" event={"ID":"21357811-694f-4a8a-a714-fe6c4292e89b","Type":"ContainerStarted","Data":"9a8561de832e65d8f8305272c74643dde59ecaaf44c84a1204c90a5398a191bf"} Sep 10 17:38:58.886431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:58.886008 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:38:58.902072 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:58.902027 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" podStartSLOduration=1.9020122069999998 podStartE2EDuration="1.902012207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:38:58.901251251 +0000 UTC m=+905.921178485" watchObservedRunningTime="2026-09-10 17:38:58.902012207 +0000 UTC m=+905.921939359" Sep 10 17:38:59.432202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:38:59.432171 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" path="/var/lib/kubelet/pods/c08f751e-b914-48a0-99d8-4a4cfc8ca8fc/volumes" Sep 10 17:39:00.026152 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:00.026124 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:02.092189 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:02.092155 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:02.203209 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:02.203181 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:02.295157 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:02.295107 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:02.397163 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:02.397096 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:02.778920 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:02.778892 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:09.894104 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:09.894071 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:39:14.534740 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:14.534705 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:15.571545 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:15.571514 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:15.671777 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:15.671738 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:18.614921 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:18.614886 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:20.354399 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:20.354356 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:28.711523 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:28.711473 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:34.484192 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:34.484145 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:34.546111 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:34.546081 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:34.643177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:34.643128 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:38.628678 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:38.628623 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:50.619109 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:50.619041 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:52.111451 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.111423 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:52.212916 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.212877 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp"] Sep 10 17:39:52.213332 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.213313 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" Sep 10 17:39:52.213422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.213334 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" Sep 10 17:39:52.213422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.213358 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" Sep 10 17:39:52.213422 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.213366 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" Sep 10 17:39:52.213580 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.213479 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08f751e-b914-48a0-99d8-4a4cfc8ca8fc" containerName="istio-proxy" Sep 10 17:39:52.213580 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.213491 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a86ab8-1ea7-4e2c-b0f5-35189f4b75c4" containerName="istio-proxy" Sep 10 17:39:52.216594 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.216572 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" Sep 10 17:39:52.218634 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.218606 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 17:39:52.218786 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.218714 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-77v6x\"" Sep 10 17:39:52.226668 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.226062 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp"] Sep 10 17:39:52.303249 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.303221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42832689-cf8b-4b2f-8baa-ab9aaedf3b5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-14b3e7-75klp\" (UID: \"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" Sep 10 17:39:52.404683 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.404607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42832689-cf8b-4b2f-8baa-ab9aaedf3b5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-14b3e7-75klp\" (UID: \"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" Sep 10 17:39:52.405230 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.405210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42832689-cf8b-4b2f-8baa-ab9aaedf3b5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-14b3e7-75klp\" (UID: \"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" Sep 10 17:39:52.531871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.531854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" Sep 10 17:39:52.804311 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.804287 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp"] Sep 10 17:39:52.805136 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:39:52.805112 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42832689_cf8b_4b2f_8baa_ab9aaedf3b5a.slice/crio-e37050be149ae09240dfcc07287c152ac5e2f33d5f39a71b50249525b3e98711 WatchSource:0}: Error finding container e37050be149ae09240dfcc07287c152ac5e2f33d5f39a71b50249525b3e98711: Status 404 returned error can't find the container with id e37050be149ae09240dfcc07287c152ac5e2f33d5f39a71b50249525b3e98711 Sep 10 17:39:52.807219 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:52.807197 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:39:53.212460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:53.212424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" event={"ID":"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a","Type":"ContainerStarted","Data":"e37050be149ae09240dfcc07287c152ac5e2f33d5f39a71b50249525b3e98711"} Sep 10 17:39:56.230582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:56.230552 2580 generic.go:356] "Generic (PLEG): container finished" podID="42832689-cf8b-4b2f-8baa-ab9aaedf3b5a" containerID="dc0319e1accb443788dc8db2de84d1b368b1a3525e6a1520e73f0852806b5515" exitCode=0 Sep 10 17:39:56.230943 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:56.230656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" event={"ID":"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a","Type":"ContainerDied","Data":"dc0319e1accb443788dc8db2de84d1b368b1a3525e6a1520e73f0852806b5515"} Sep 10 17:39:56.462960 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:56.462931 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:56.573955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:56.573887 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:56.663915 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:56.663873 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:57.377033 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:57.377010 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" Sep 10 17:39:57.446565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:57.446538 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42832689-cf8b-4b2f-8baa-ab9aaedf3b5a-maas-api-service-ca\") pod \"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a\" (UID: \"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a\") " Sep 10 17:39:57.446857 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:57.446836 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42832689-cf8b-4b2f-8baa-ab9aaedf3b5a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42832689-cf8b-4b2f-8baa-ab9aaedf3b5a" (UID: "42832689-cf8b-4b2f-8baa-ab9aaedf3b5a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:39:57.548237 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:57.548169 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42832689-cf8b-4b2f-8baa-ab9aaedf3b5a-maas-api-service-ca\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:39:57.590288 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:57.590251 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:39:58.244328 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:58.244305 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" Sep 10 17:39:58.244498 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:58.244345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp" event={"ID":"42832689-cf8b-4b2f-8baa-ab9aaedf3b5a","Type":"ContainerDied","Data":"e37050be149ae09240dfcc07287c152ac5e2f33d5f39a71b50249525b3e98711"} Sep 10 17:39:58.244498 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:39:58.244395 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e37050be149ae09240dfcc07287c152ac5e2f33d5f39a71b50249525b3e98711" Sep 10 17:40:02.758251 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:02.758214 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:02.777708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:02.777672 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc"] Sep 10 17:40:02.777972 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:02.777946 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" podUID="21357811-694f-4a8a-a714-fe6c4292e89b" containerName="payload-processing" containerID="cri-o://826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0" gracePeriod=30 Sep 10 17:40:02.956958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:02.956932 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp"] Sep 10 17:40:02.960501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:02.960469 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-14b3e7-75klp"] Sep 10 17:40:03.039426 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.039395 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:40:03.197342 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.197313 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21357811-694f-4a8a-a714-fe6c4292e89b-plugins-config-volume\") pod \"21357811-694f-4a8a-a714-fe6c4292e89b\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " Sep 10 17:40:03.197342 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.197342 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bbd5\" (UniqueName: \"kubernetes.io/projected/21357811-694f-4a8a-a714-fe6c4292e89b-kube-api-access-8bbd5\") pod \"21357811-694f-4a8a-a714-fe6c4292e89b\" (UID: \"21357811-694f-4a8a-a714-fe6c4292e89b\") " Sep 10 17:40:03.197725 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.197697 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21357811-694f-4a8a-a714-fe6c4292e89b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21357811-694f-4a8a-a714-fe6c4292e89b" (UID: "21357811-694f-4a8a-a714-fe6c4292e89b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:40:03.199724 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.199702 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21357811-694f-4a8a-a714-fe6c4292e89b-kube-api-access-8bbd5" (OuterVolumeSpecName: "kube-api-access-8bbd5") pod "21357811-694f-4a8a-a714-fe6c4292e89b" (UID: "21357811-694f-4a8a-a714-fe6c4292e89b"). InnerVolumeSpecName "kube-api-access-8bbd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:40:03.275969 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.275901 2580 generic.go:356] "Generic (PLEG): container finished" podID="21357811-694f-4a8a-a714-fe6c4292e89b" containerID="826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0" exitCode=0 Sep 10 17:40:03.275969 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.275944 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" Sep 10 17:40:03.276113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.275990 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" event={"ID":"21357811-694f-4a8a-a714-fe6c4292e89b","Type":"ContainerDied","Data":"826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0"} Sep 10 17:40:03.276113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.276040 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc" event={"ID":"21357811-694f-4a8a-a714-fe6c4292e89b","Type":"ContainerDied","Data":"9a8561de832e65d8f8305272c74643dde59ecaaf44c84a1204c90a5398a191bf"} Sep 10 17:40:03.276113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.276064 2580 scope.go:117] "RemoveContainer" containerID="826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0" Sep 10 17:40:03.285382 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.285367 2580 scope.go:117] "RemoveContainer" containerID="826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0" Sep 10 17:40:03.285626 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:40:03.285608 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0\": container with ID starting with 826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0 not found: ID does not exist" containerID="826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0" Sep 10 17:40:03.285717 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.285633 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0"} err="failed to get container status \"826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0\": rpc error: code = NotFound desc = could not find container \"826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0\": container with ID starting with 826cdf517de63105a5639f64068271ca880aaa40e1ba430534e6fc497f8753e0 not found: ID does not exist" Sep 10 17:40:03.297823 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.297797 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc"] Sep 10 17:40:03.298162 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.298144 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21357811-694f-4a8a-a714-fe6c4292e89b-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:40:03.298208 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.298165 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bbd5\" (UniqueName: \"kubernetes.io/projected/21357811-694f-4a8a-a714-fe6c4292e89b-kube-api-access-8bbd5\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:40:03.302065 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.302046 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc"] Sep 10 17:40:03.437630 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.437599 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21357811-694f-4a8a-a714-fe6c4292e89b" path="/var/lib/kubelet/pods/21357811-694f-4a8a-a714-fe6c4292e89b/volumes" Sep 10 17:40:03.437941 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.437928 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42832689-cf8b-4b2f-8baa-ab9aaedf3b5a" path="/var/lib/kubelet/pods/42832689-cf8b-4b2f-8baa-ab9aaedf3b5a/volumes" Sep 10 17:40:03.894191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:03.894161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:07.219691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:07.219662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:08.061161 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:08.061133 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:09.138473 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:09.138438 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:09.208237 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:09.208206 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:09.412778 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:09.412689 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:09.884086 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:09.884051 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:10.197614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.197536 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj"] Sep 10 17:40:10.197975 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.197905 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21357811-694f-4a8a-a714-fe6c4292e89b" containerName="payload-processing" Sep 10 17:40:10.197975 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.197917 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="21357811-694f-4a8a-a714-fe6c4292e89b" containerName="payload-processing" Sep 10 17:40:10.197975 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.197938 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42832689-cf8b-4b2f-8baa-ab9aaedf3b5a" containerName="revoke-keys" Sep 10 17:40:10.197975 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.197944 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="42832689-cf8b-4b2f-8baa-ab9aaedf3b5a" containerName="revoke-keys" Sep 10 17:40:10.198111 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.198005 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="21357811-694f-4a8a-a714-fe6c4292e89b" containerName="payload-processing" Sep 10 17:40:10.198111 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.198015 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="42832689-cf8b-4b2f-8baa-ab9aaedf3b5a" containerName="revoke-keys" Sep 10 17:40:10.202301 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.202283 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.204423 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.204404 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-085b3b-openshift-default-dockercfg-9wnrx\"" Sep 10 17:40:10.214075 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.214051 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj"] Sep 10 17:40:10.226984 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.226952 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:10.341395 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.341362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:10.350566 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-certs\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350669 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-istio-token\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350669 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/951ba62b-27d9-487b-b282-46826f0559dd-istiod-ca-cert\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350669 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-data\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-socket\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-credential-socket\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350831 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qng4\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-kube-api-access-7qng4\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350899 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/951ba62b-27d9-487b-b282-46826f0559dd-istio-podinfo\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.350935 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.350922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-envoy\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452064 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/951ba62b-27d9-487b-b282-46826f0559dd-istio-podinfo\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-envoy\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-certs\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-istio-token\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/951ba62b-27d9-487b-b282-46826f0559dd-istiod-ca-cert\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-data\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-socket\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-credential-socket\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qng4\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-kube-api-access-7qng4\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452626 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452571 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-socket\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452712 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-data\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.452803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452780 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-credential-socket\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.453064 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.452854 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-certs\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.453064 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.453000 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/951ba62b-27d9-487b-b282-46826f0559dd-istiod-ca-cert\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.454739 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.454709 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-envoy\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.454819 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.454777 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/951ba62b-27d9-487b-b282-46826f0559dd-istio-podinfo\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.460274 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.460250 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-istio-token\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.460672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.460633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qng4\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-kube-api-access-7qng4\") pod \"e2e-noten-085b3b-openshift-default-6567d88cfb-txngj\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.512687 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.512667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:10.792224 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.792195 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj"] Sep 10 17:40:10.794133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:40:10.794098 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951ba62b_27d9_487b_b282_46826f0559dd.slice/crio-a5657b4badf33f0450d86cf9ed1ac562227a18738cc9a1373b13293b02ba6d8b WatchSource:0}: Error finding container a5657b4badf33f0450d86cf9ed1ac562227a18738cc9a1373b13293b02ba6d8b: Status 404 returned error can't find the container with id a5657b4badf33f0450d86cf9ed1ac562227a18738cc9a1373b13293b02ba6d8b Sep 10 17:40:10.796199 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.796169 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:40:10.796292 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.796234 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:40:10.796292 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:10.796261 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:40:11.323848 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.323816 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" event={"ID":"951ba62b-27d9-487b-b282-46826f0559dd","Type":"ContainerStarted","Data":"506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82"} Sep 10 17:40:11.324183 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.323875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" event={"ID":"951ba62b-27d9-487b-b282-46826f0559dd","Type":"ContainerStarted","Data":"a5657b4badf33f0450d86cf9ed1ac562227a18738cc9a1373b13293b02ba6d8b"} Sep 10 17:40:11.344510 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.344462 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" podStartSLOduration=1.344445276 podStartE2EDuration="1.344445276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:11.343101136 +0000 UTC m=+978.363028286" watchObservedRunningTime="2026-09-10 17:40:11.344445276 +0000 UTC m=+978.364372441" Sep 10 17:40:11.513258 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.513224 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:11.517864 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.517839 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:11.624148 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.624071 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:11.721758 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.721726 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:11.835502 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:11.835476 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:12.329393 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:12.329366 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:12.330140 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:12.330123 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:40:14.147731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:14.147693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:14.248020 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:14.247989 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:14.347917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:14.347892 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:14.447939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:14.447870 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:14.548224 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:14.548143 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:15.232123 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:15.232098 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:15.332808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:15.332780 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:15.433602 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:15.433571 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:17.103768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:17.103737 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:23.156708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:23.156663 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:23.257061 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:23.257030 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:23.879010 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:23.878978 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:29.736256 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:29.736223 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:29.800988 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:29.800949 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:30.020320 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:30.020262 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:30.342326 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:30.342249 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:30.499707 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:30.499673 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:33.826432 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:33.826398 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:33.937511 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:33.937485 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:34.976543 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:34.976496 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:35.037762 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:35.037732 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:35.206592 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:35.206562 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:35.481813 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:35.481779 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:35.585097 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:35.585065 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:58.839297 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:58.839265 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:59.483508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:59.483475 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:59.580616 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:59.580586 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:59.829935 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:59.829853 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:59.934879 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:40:59.934847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:02.006280 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:02.006242 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:02.923318 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:02.923287 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:03.015088 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.015053 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb"] Sep 10 17:41:03.018213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.018195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" Sep 10 17:41:03.020475 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.020452 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 17:41:03.020575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.020485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-77v6x\"" Sep 10 17:41:03.026398 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.026373 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb"] Sep 10 17:41:03.071108 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.071087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb\" (UID: \"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" Sep 10 17:41:03.126227 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.126204 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:03.172139 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.172118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb\" (UID: \"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" Sep 10 17:41:03.172620 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.172602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb\" (UID: \"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" Sep 10 17:41:03.329889 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.329860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" Sep 10 17:41:03.598085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:03.598064 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb"] Sep 10 17:41:03.599956 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:41:03.599931 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6a5b7d_d30e_4db0_a5cc_b3f1c1ecb9a0.slice/crio-403fa85fbe78601da8c5834df5c8ab2bb295c476cfc50744bd9a80b092ce066f WatchSource:0}: Error finding container 403fa85fbe78601da8c5834df5c8ab2bb295c476cfc50744bd9a80b092ce066f: Status 404 returned error can't find the container with id 403fa85fbe78601da8c5834df5c8ab2bb295c476cfc50744bd9a80b092ce066f Sep 10 17:41:04.609495 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:04.609429 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0" containerID="20c650acdde46049ed83dc0751bb7e3bf4e2ee40c7ddac2c0ae79a5a91d004d7" exitCode=0 Sep 10 17:41:04.609833 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:04.609518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" event={"ID":"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0","Type":"ContainerDied","Data":"20c650acdde46049ed83dc0751bb7e3bf4e2ee40c7ddac2c0ae79a5a91d004d7"} Sep 10 17:41:04.609833 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:04.609564 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" event={"ID":"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0","Type":"ContainerStarted","Data":"403fa85fbe78601da8c5834df5c8ab2bb295c476cfc50744bd9a80b092ce066f"} Sep 10 17:41:05.743967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:05.743946 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" Sep 10 17:41:05.793743 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:05.793717 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0-maas-api-service-ca\") pod \"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0\" (UID: \"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0\") " Sep 10 17:41:05.794052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:05.794026 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0" (UID: "7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:05.894431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:05.894367 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0-maas-api-service-ca\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:06.065122 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.065094 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:06.165781 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.165689 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:06.418001 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.417933 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs"] Sep 10 17:41:06.418343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.418327 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0" containerName="revoke-keys" Sep 10 17:41:06.418343 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.418343 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0" containerName="revoke-keys" Sep 10 17:41:06.418486 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.418430 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0" containerName="revoke-keys" Sep 10 17:41:06.420435 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.420416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" Sep 10 17:41:06.430688 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.430666 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs"] Sep 10 17:41:06.501252 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.501218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b68d7ab9-7d37-4661-bb1d-4ac972518027-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aee2c26d-256qs\" (UID: \"b68d7ab9-7d37-4661-bb1d-4ac972518027\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" Sep 10 17:41:06.521213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.521188 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:06.602431 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.602397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b68d7ab9-7d37-4661-bb1d-4ac972518027-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aee2c26d-256qs\" (UID: \"b68d7ab9-7d37-4661-bb1d-4ac972518027\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" Sep 10 17:41:06.603071 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.603053 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b68d7ab9-7d37-4661-bb1d-4ac972518027-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aee2c26d-256qs\" (UID: \"b68d7ab9-7d37-4661-bb1d-4ac972518027\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" Sep 10 17:41:06.621951 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.621928 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" Sep 10 17:41:06.622069 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.621962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb" event={"ID":"7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0","Type":"ContainerDied","Data":"403fa85fbe78601da8c5834df5c8ab2bb295c476cfc50744bd9a80b092ce066f"} Sep 10 17:41:06.622069 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.622002 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="403fa85fbe78601da8c5834df5c8ab2bb295c476cfc50744bd9a80b092ce066f" Sep 10 17:41:06.732352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:06.732330 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" Sep 10 17:41:07.001543 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:07.001519 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs"] Sep 10 17:41:07.004038 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:41:07.004011 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68d7ab9_7d37_4661_bb1d_4ac972518027.slice/crio-f41370c14cb20033841acd17886de35eff4d9e7f51d282a59d42a7cde5be734e WatchSource:0}: Error finding container f41370c14cb20033841acd17886de35eff4d9e7f51d282a59d42a7cde5be734e: Status 404 returned error can't find the container with id f41370c14cb20033841acd17886de35eff4d9e7f51d282a59d42a7cde5be734e Sep 10 17:41:07.628606 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:07.628521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" event={"ID":"b68d7ab9-7d37-4661-bb1d-4ac972518027","Type":"ContainerStarted","Data":"fe76c6f7f8015f657b5743bb78965faff46cd8de4191c68f96e6ce157dc4372b"} Sep 10 17:41:07.628606 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:07.628587 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" event={"ID":"b68d7ab9-7d37-4661-bb1d-4ac972518027","Type":"ContainerStarted","Data":"f41370c14cb20033841acd17886de35eff4d9e7f51d282a59d42a7cde5be734e"} Sep 10 17:41:07.644056 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:07.644007 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" podStartSLOduration=1.643987202 podStartE2EDuration="1.643987202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:07.643420518 +0000 UTC m=+1034.663347670" watchObservedRunningTime="2026-09-10 17:41:07.643987202 +0000 UTC m=+1034.663914353" Sep 10 17:41:08.635247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:08.635216 2580 generic.go:356] "Generic (PLEG): container finished" podID="b68d7ab9-7d37-4661-bb1d-4ac972518027" containerID="fe76c6f7f8015f657b5743bb78965faff46cd8de4191c68f96e6ce157dc4372b" exitCode=0 Sep 10 17:41:08.635247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:08.635248 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" event={"ID":"b68d7ab9-7d37-4661-bb1d-4ac972518027","Type":"ContainerDied","Data":"fe76c6f7f8015f657b5743bb78965faff46cd8de4191c68f96e6ce157dc4372b"} Sep 10 17:41:09.774135 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:09.774111 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" Sep 10 17:41:09.829096 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:09.829072 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b68d7ab9-7d37-4661-bb1d-4ac972518027-maas-api-service-ca\") pod \"b68d7ab9-7d37-4661-bb1d-4ac972518027\" (UID: \"b68d7ab9-7d37-4661-bb1d-4ac972518027\") " Sep 10 17:41:09.829452 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:09.829421 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b68d7ab9-7d37-4661-bb1d-4ac972518027-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b68d7ab9-7d37-4661-bb1d-4ac972518027" (UID: "b68d7ab9-7d37-4661-bb1d-4ac972518027"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:09.930202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:09.930144 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b68d7ab9-7d37-4661-bb1d-4ac972518027-maas-api-service-ca\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:10.652214 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:10.652187 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" Sep 10 17:41:10.652214 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:10.652203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs" event={"ID":"b68d7ab9-7d37-4661-bb1d-4ac972518027","Type":"ContainerDied","Data":"f41370c14cb20033841acd17886de35eff4d9e7f51d282a59d42a7cde5be734e"} Sep 10 17:41:10.652447 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:10.652248 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f41370c14cb20033841acd17886de35eff4d9e7f51d282a59d42a7cde5be734e" Sep 10 17:41:13.147076 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.147037 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:13.740222 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.740184 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:13.774141 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.774110 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k"] Sep 10 17:41:13.774407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.774354 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" podUID="9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" containerName="payload-processing" containerID="cri-o://36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5" gracePeriod=30 Sep 10 17:41:13.781087 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.781060 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4"] Sep 10 17:41:13.781466 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.781434 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" podUID="f989d0fb-348d-405e-81f2-b300f1f7efd3" containerName="payload-pre-processing" containerID="cri-o://9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd" gracePeriod=30 Sep 10 17:41:13.816787 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.816754 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:13.877412 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.877389 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:13.932197 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.932150 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb"] Sep 10 17:41:13.934481 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.934454 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d25fa-4jvtb"] Sep 10 17:41:13.941391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:13.941365 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:14.063877 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.063854 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:41:14.066819 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.066801 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:41:14.161440 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.161415 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f989d0fb-348d-405e-81f2-b300f1f7efd3-plugins-config-volume\") pod \"f989d0fb-348d-405e-81f2-b300f1f7efd3\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " Sep 10 17:41:14.161808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.161532 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbqjz\" (UniqueName: \"kubernetes.io/projected/f989d0fb-348d-405e-81f2-b300f1f7efd3-kube-api-access-xbqjz\") pod \"f989d0fb-348d-405e-81f2-b300f1f7efd3\" (UID: \"f989d0fb-348d-405e-81f2-b300f1f7efd3\") " Sep 10 17:41:14.161808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.161583 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7v8p\" (UniqueName: \"kubernetes.io/projected/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-kube-api-access-x7v8p\") pod \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " Sep 10 17:41:14.161808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.161620 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-plugins-config-volume\") pod \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\" (UID: \"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e\") " Sep 10 17:41:14.161808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.161792 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f989d0fb-348d-405e-81f2-b300f1f7efd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f989d0fb-348d-405e-81f2-b300f1f7efd3" (UID: "f989d0fb-348d-405e-81f2-b300f1f7efd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:14.162035 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.162003 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f989d0fb-348d-405e-81f2-b300f1f7efd3-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:14.162092 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.162069 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" (UID: "9d03794a-89d3-4eda-b1b7-8d541ea8ef7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:14.164354 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.164328 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-kube-api-access-x7v8p" (OuterVolumeSpecName: "kube-api-access-x7v8p") pod "9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" (UID: "9d03794a-89d3-4eda-b1b7-8d541ea8ef7e"). InnerVolumeSpecName "kube-api-access-x7v8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:41:14.164354 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.164341 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f989d0fb-348d-405e-81f2-b300f1f7efd3-kube-api-access-xbqjz" (OuterVolumeSpecName: "kube-api-access-xbqjz") pod "f989d0fb-348d-405e-81f2-b300f1f7efd3" (UID: "f989d0fb-348d-405e-81f2-b300f1f7efd3"). InnerVolumeSpecName "kube-api-access-xbqjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:41:14.263017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.262992 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7v8p\" (UniqueName: \"kubernetes.io/projected/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-kube-api-access-x7v8p\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:14.263017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.263013 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:14.263151 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.263022 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbqjz\" (UniqueName: \"kubernetes.io/projected/f989d0fb-348d-405e-81f2-b300f1f7efd3-kube-api-access-xbqjz\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:14.290472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.290450 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:14.675257 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.675231 2580 generic.go:356] "Generic (PLEG): container finished" podID="f989d0fb-348d-405e-81f2-b300f1f7efd3" containerID="9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd" exitCode=0 Sep 10 17:41:14.675400 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.675282 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" Sep 10 17:41:14.675400 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.675314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" event={"ID":"f989d0fb-348d-405e-81f2-b300f1f7efd3","Type":"ContainerDied","Data":"9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd"} Sep 10 17:41:14.675400 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.675368 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4" event={"ID":"f989d0fb-348d-405e-81f2-b300f1f7efd3","Type":"ContainerDied","Data":"3cc5717c2ed6ad9d685688e10572b7b47904410640b0cfd67b73636e76a975da"} Sep 10 17:41:14.675400 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.675400 2580 scope.go:117] "RemoveContainer" containerID="9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd" Sep 10 17:41:14.683976 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.683949 2580 generic.go:356] "Generic (PLEG): container finished" podID="9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" containerID="36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5" exitCode=0 Sep 10 17:41:14.684095 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.684002 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" Sep 10 17:41:14.684095 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.684062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" event={"ID":"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e","Type":"ContainerDied","Data":"36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5"} Sep 10 17:41:14.684224 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.684210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k" event={"ID":"9d03794a-89d3-4eda-b1b7-8d541ea8ef7e","Type":"ContainerDied","Data":"c61a6b734b366643cfc93585c1d9839e9c8a89df6747a421c6fdd64d71e40e41"} Sep 10 17:41:14.691972 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.691957 2580 scope.go:117] "RemoveContainer" containerID="9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd" Sep 10 17:41:14.692296 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:41:14.692272 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd\": container with ID starting with 9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd not found: ID does not exist" containerID="9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd" Sep 10 17:41:14.692393 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.692305 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd"} err="failed to get container status \"9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd\": rpc error: code = NotFound desc = could not find container \"9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd\": container with ID starting with 9a4d8e0522ddd70de386ad023633c27330febeba5741af1caa85845e876c34fd not found: ID does not exist" Sep 10 17:41:14.692393 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.692326 2580 scope.go:117] "RemoveContainer" containerID="36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5" Sep 10 17:41:14.700442 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.700424 2580 scope.go:117] "RemoveContainer" containerID="36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5" Sep 10 17:41:14.700720 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:41:14.700702 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5\": container with ID starting with 36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5 not found: ID does not exist" containerID="36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5" Sep 10 17:41:14.700785 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.700727 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5"} err="failed to get container status \"36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5\": rpc error: code = NotFound desc = could not find container \"36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5\": container with ID starting with 36c1acf7dc4d3b0100e12a4ea8224842a1f264e7f76975ff300e1b928e0720f5 not found: ID does not exist" Sep 10 17:41:14.700913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.700897 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4"] Sep 10 17:41:14.705038 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.705018 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4"] Sep 10 17:41:14.722992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.722966 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k"] Sep 10 17:41:14.729117 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:14.729100 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k"] Sep 10 17:41:15.432065 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:15.432041 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0" path="/var/lib/kubelet/pods/7a6a5b7d-d30e-4db0-a5cc-b3f1c1ecb9a0/volumes" Sep 10 17:41:15.432379 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:15.432353 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" path="/var/lib/kubelet/pods/9d03794a-89d3-4eda-b1b7-8d541ea8ef7e/volumes" Sep 10 17:41:15.432668 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:15.432632 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f989d0fb-348d-405e-81f2-b300f1f7efd3" path="/var/lib/kubelet/pods/f989d0fb-348d-405e-81f2-b300f1f7efd3/volumes" Sep 10 17:41:16.638285 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:16.638252 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:17.312680 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:17.312630 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:17.388449 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:17.388413 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:17.488485 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:17.488450 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:17.533383 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:17.533348 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs"] Sep 10 17:41:17.536118 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:17.536097 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aee2c26d-256qs"] Sep 10 17:41:17.585710 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:17.585620 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:17.885802 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:17.885733 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:19.318233 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:19.318195 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:19.402484 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:19.402456 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj"] Sep 10 17:41:19.402699 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:19.402667 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" podUID="951ba62b-27d9-487b-b282-46826f0559dd" containerName="istio-proxy" containerID="cri-o://506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82" gracePeriod=30 Sep 10 17:41:19.427308 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:19.427264 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:19.431814 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:19.431789 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b68d7ab9-7d37-4661-bb1d-4ac972518027" path="/var/lib/kubelet/pods/b68d7ab9-7d37-4661-bb1d-4ac972518027/volumes" Sep 10 17:41:19.638429 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:19.638337 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:19.757083 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:19.757050 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:20.396540 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:20.396512 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:20.497318 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:20.497283 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:20.718992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:20.718959 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f"] Sep 10 17:41:20.719189 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:20.719168 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" containerID="cri-o://057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5" gracePeriod=30 Sep 10 17:41:20.755789 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:20.755766 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:21.050075 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.049989 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr"] Sep 10 17:41:21.050366 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050352 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" containerName="payload-processing" Sep 10 17:41:21.050418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050368 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" containerName="payload-processing" Sep 10 17:41:21.050418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050377 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68d7ab9-7d37-4661-bb1d-4ac972518027" containerName="revoke-keys" Sep 10 17:41:21.050418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050383 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68d7ab9-7d37-4661-bb1d-4ac972518027" containerName="revoke-keys" Sep 10 17:41:21.050418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050394 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f989d0fb-348d-405e-81f2-b300f1f7efd3" containerName="payload-pre-processing" Sep 10 17:41:21.050418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050400 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f989d0fb-348d-405e-81f2-b300f1f7efd3" containerName="payload-pre-processing" Sep 10 17:41:21.050570 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050461 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d03794a-89d3-4eda-b1b7-8d541ea8ef7e" containerName="payload-processing" Sep 10 17:41:21.050570 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050469 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f989d0fb-348d-405e-81f2-b300f1f7efd3" containerName="payload-pre-processing" Sep 10 17:41:21.050570 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.050479 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b68d7ab9-7d37-4661-bb1d-4ac972518027" containerName="revoke-keys" Sep 10 17:41:21.053726 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.053711 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" Sep 10 17:41:21.055896 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.055872 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-77v6x\"" Sep 10 17:41:21.055896 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.055872 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 17:41:21.063172 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.063152 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr"] Sep 10 17:41:21.157907 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.157882 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:21.217493 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.217467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ecd146-e76e-4331-a963-9417926d5bb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr\" (UID: \"56ecd146-e76e-4331-a963-9417926d5bb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" Sep 10 17:41:21.318921 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.318838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ecd146-e76e-4331-a963-9417926d5bb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr\" (UID: \"56ecd146-e76e-4331-a963-9417926d5bb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" Sep 10 17:41:21.319447 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.319428 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ecd146-e76e-4331-a963-9417926d5bb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr\" (UID: \"56ecd146-e76e-4331-a963-9417926d5bb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" Sep 10 17:41:21.365450 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.365427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" Sep 10 17:41:21.634368 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.634342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr"] Sep 10 17:41:21.636212 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:41:21.636178 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ecd146_e76e_4331_a963_9417926d5bb0.slice/crio-61fe4c6fa609cc5f12b255c807e0db874f0745a780f72d5bae2293419e568482 WatchSource:0}: Error finding container 61fe4c6fa609cc5f12b255c807e0db874f0745a780f72d5bae2293419e568482: Status 404 returned error can't find the container with id 61fe4c6fa609cc5f12b255c807e0db874f0745a780f72d5bae2293419e568482 Sep 10 17:41:21.725685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:21.725630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" event={"ID":"56ecd146-e76e-4331-a963-9417926d5bb0","Type":"ContainerStarted","Data":"61fe4c6fa609cc5f12b255c807e0db874f0745a780f72d5bae2293419e568482"} Sep 10 17:41:22.732321 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:22.732292 2580 generic.go:356] "Generic (PLEG): container finished" podID="56ecd146-e76e-4331-a963-9417926d5bb0" containerID="b71f7cd289114d2ff2874dcc43420281f01f1b5a43b0cbe4c8e97e985b8a83cc" exitCode=0 Sep 10 17:41:22.732669 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:22.732385 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" event={"ID":"56ecd146-e76e-4331-a963-9417926d5bb0","Type":"ContainerDied","Data":"b71f7cd289114d2ff2874dcc43420281f01f1b5a43b0cbe4c8e97e985b8a83cc"} Sep 10 17:41:23.743951 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:23.743922 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:23.845414 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:23.845378 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:23.869472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:23.869449 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" Sep 10 17:41:23.995365 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:23.995280 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:24.039805 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.039784 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ecd146-e76e-4331-a963-9417926d5bb0-maas-api-service-ca\") pod \"56ecd146-e76e-4331-a963-9417926d5bb0\" (UID: \"56ecd146-e76e-4331-a963-9417926d5bb0\") " Sep 10 17:41:24.040186 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.040159 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56ecd146-e76e-4331-a963-9417926d5bb0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "56ecd146-e76e-4331-a963-9417926d5bb0" (UID: "56ecd146-e76e-4331-a963-9417926d5bb0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:24.141125 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.141095 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ecd146-e76e-4331-a963-9417926d5bb0-maas-api-service-ca\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.362137 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.362032 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:24.461938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.461914 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:24.562191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.562163 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:24.653221 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.653201 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:41:24.744110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744081 2580 generic.go:356] "Generic (PLEG): container finished" podID="951ba62b-27d9-487b-b282-46826f0559dd" containerID="506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82" exitCode=0 Sep 10 17:41:24.744450 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" event={"ID":"951ba62b-27d9-487b-b282-46826f0559dd","Type":"ContainerDied","Data":"506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82"} Sep 10 17:41:24.744450 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" event={"ID":"951ba62b-27d9-487b-b282-46826f0559dd","Type":"ContainerDied","Data":"a5657b4badf33f0450d86cf9ed1ac562227a18738cc9a1373b13293b02ba6d8b"} Sep 10 17:41:24.744450 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744193 2580 scope.go:117] "RemoveContainer" containerID="506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82" Sep 10 17:41:24.744450 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744126 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj" Sep 10 17:41:24.744653 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744621 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-credential-socket\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.744714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744679 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/951ba62b-27d9-487b-b282-46826f0559dd-istio-podinfo\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.744714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744710 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-certs\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.744815 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744738 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-istio-token\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.744815 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744769 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-socket\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.744815 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744802 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qng4\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-kube-api-access-7qng4\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.744964 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744853 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/951ba62b-27d9-487b-b282-46826f0559dd-istiod-ca-cert\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.744964 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744917 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-envoy\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.745062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.744995 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-data\") pod \"951ba62b-27d9-487b-b282-46826f0559dd\" (UID: \"951ba62b-27d9-487b-b282-46826f0559dd\") " Sep 10 17:41:24.745062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.745014 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:24.745062 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.745048 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:24.745468 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.745309 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.745468 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.745331 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.745468 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.745354 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951ba62b-27d9-487b-b282-46826f0559dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:24.745468 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.745354 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:24.746377 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.745703 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:24.746377 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.746048 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" Sep 10 17:41:24.746377 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.746129 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr" event={"ID":"56ecd146-e76e-4331-a963-9417926d5bb0","Type":"ContainerDied","Data":"61fe4c6fa609cc5f12b255c807e0db874f0745a780f72d5bae2293419e568482"} Sep 10 17:41:24.746377 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.746179 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61fe4c6fa609cc5f12b255c807e0db874f0745a780f72d5bae2293419e568482" Sep 10 17:41:24.747908 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.747887 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/951ba62b-27d9-487b-b282-46826f0559dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:41:24.748018 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.747969 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:24.748018 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.747989 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:41:24.748018 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.747994 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-kube-api-access-7qng4" (OuterVolumeSpecName: "kube-api-access-7qng4") pod "951ba62b-27d9-487b-b282-46826f0559dd" (UID: "951ba62b-27d9-487b-b282-46826f0559dd"). InnerVolumeSpecName "kube-api-access-7qng4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:41:24.755901 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.755886 2580 scope.go:117] "RemoveContainer" containerID="506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82" Sep 10 17:41:24.756145 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:41:24.756127 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82\": container with ID starting with 506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82 not found: ID does not exist" containerID="506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82" Sep 10 17:41:24.756185 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.756153 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82"} err="failed to get container status \"506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82\": rpc error: code = NotFound desc = could not find container \"506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82\": container with ID starting with 506023e6b3aad2ce83796f7023a6bcbd8af894e1e8ec95510eb48f857216cd82 not found: ID does not exist" Sep 10 17:41:24.829391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.829370 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:24.846159 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.846141 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.846216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.846159 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/951ba62b-27d9-487b-b282-46826f0559dd-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.846216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.846169 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.846216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.846177 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qng4\" (UniqueName: \"kubernetes.io/projected/951ba62b-27d9-487b-b282-46826f0559dd-kube-api-access-7qng4\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.846216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.846185 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/951ba62b-27d9-487b-b282-46826f0559dd-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.846216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.846192 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:24.846216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:24.846199 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/951ba62b-27d9-487b-b282-46826f0559dd-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:25.069577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:25.069551 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj"] Sep 10 17:41:25.073556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:25.073534 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj"] Sep 10 17:41:25.432168 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:25.432104 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951ba62b-27d9-487b-b282-46826f0559dd" path="/var/lib/kubelet/pods/951ba62b-27d9-487b-b282-46826f0559dd/volumes" Sep 10 17:41:25.472504 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:25.472476 2580 patch_prober.go:28] interesting pod/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 17:41:25.472604 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:25.472539 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:41:25.961186 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:25.961166 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:41:26.054808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.054746 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-envoy\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.054808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.054776 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-data\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.054808 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.054794 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-podinfo\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.055052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.054824 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-certs\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.055052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.054959 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24ccl\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-kube-api-access-24ccl\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.055052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055011 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a837079-d53c-48ed-ac43-c02741bb90ef-istiod-ca-cert\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.055195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055061 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:26.055195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055075 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-credential-socket\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.055195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055091 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:26.055195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055118 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-socket\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.055195 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055143 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-token\") pod \"5a837079-d53c-48ed-ac43-c02741bb90ef\" (UID: \"5a837079-d53c-48ed-ac43-c02741bb90ef\") " Sep 10 17:41:26.055588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055295 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:26.055588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055330 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:26.055588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055399 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a837079-d53c-48ed-ac43-c02741bb90ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:26.055588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055502 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.055588 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055520 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.055879 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055583 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a837079-d53c-48ed-ac43-c02741bb90ef-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.055879 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055738 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.055879 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.055753 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.057102 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.057072 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:41:26.057200 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.057104 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:41:26.057200 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.057168 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-kube-api-access-24ccl" (OuterVolumeSpecName: "kube-api-access-24ccl") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "kube-api-access-24ccl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:41:26.057493 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.057477 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a837079-d53c-48ed-ac43-c02741bb90ef" (UID: "5a837079-d53c-48ed-ac43-c02741bb90ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:41:26.156682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.156661 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.156682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.156679 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.156792 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.156688 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a837079-d53c-48ed-ac43-c02741bb90ef-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.156792 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.156695 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24ccl\" (UniqueName: \"kubernetes.io/projected/5a837079-d53c-48ed-ac43-c02741bb90ef-kube-api-access-24ccl\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:26.758720 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.758692 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerID="057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5" exitCode=0 Sep 10 17:41:26.758861 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.758733 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" Sep 10 17:41:26.758861 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.758776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" event={"ID":"5a837079-d53c-48ed-ac43-c02741bb90ef","Type":"ContainerDied","Data":"057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5"} Sep 10 17:41:26.758861 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.758829 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f" event={"ID":"5a837079-d53c-48ed-ac43-c02741bb90ef","Type":"ContainerDied","Data":"3ffa39df5570d046485054913ec915e58d48ba2f5e3a2aa1908e57b0ed8704a5"} Sep 10 17:41:26.758861 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.758856 2580 scope.go:117] "RemoveContainer" containerID="057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5" Sep 10 17:41:26.770232 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.770210 2580 scope.go:117] "RemoveContainer" containerID="1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f" Sep 10 17:41:26.778897 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.778879 2580 scope.go:117] "RemoveContainer" containerID="057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5" Sep 10 17:41:26.779150 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:41:26.779131 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5\": container with ID starting with 057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5 not found: ID does not exist" containerID="057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5" Sep 10 17:41:26.779220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.779161 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5"} err="failed to get container status \"057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5\": rpc error: code = NotFound desc = could not find container \"057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5\": container with ID starting with 057c645b010923870e351e41db5e2cedc317d5f36fa747deef6cd434e0c1e9a5 not found: ID does not exist" Sep 10 17:41:26.779220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.779183 2580 scope.go:117] "RemoveContainer" containerID="1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f" Sep 10 17:41:26.779473 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:41:26.779454 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f\": container with ID starting with 1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f not found: ID does not exist" containerID="1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f" Sep 10 17:41:26.779540 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.779479 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f"} err="failed to get container status \"1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f\": rpc error: code = NotFound desc = could not find container \"1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f\": container with ID starting with 1fa4c680f846b20d45ae6a9934df4b5b5934036d95a25fcbf36a238d4d20310f not found: ID does not exist" Sep 10 17:41:26.782856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.782836 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f"] Sep 10 17:41:26.786321 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:26.786303 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f"] Sep 10 17:41:27.431703 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:27.431680 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" path="/var/lib/kubelet/pods/5a837079-d53c-48ed-ac43-c02741bb90ef/volumes" Sep 10 17:41:30.428298 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:30.428271 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:30.535537 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:30.535506 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:30.630706 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:30.630678 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:30.761145 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:30.761123 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:31.580993 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.580963 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:31.608957 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.608931 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97"] Sep 10 17:41:31.609170 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.609148 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" podUID="88d230c2-1d67-4a64-8756-4462519b2d7c" containerName="payload-processing" containerID="cri-o://0c7a08f084d681d6d484a90c85dd55ab91488ff6b9406bc38ae45651f8cd60ea" gracePeriod=30 Sep 10 17:41:31.681404 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.681374 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:31.775086 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.775050 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr"] Sep 10 17:41:31.777075 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.777044 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:31.778693 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.778670 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f1093-dn5dr"] Sep 10 17:41:31.787744 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.787723 2580 generic.go:356] "Generic (PLEG): container finished" podID="88d230c2-1d67-4a64-8756-4462519b2d7c" containerID="0c7a08f084d681d6d484a90c85dd55ab91488ff6b9406bc38ae45651f8cd60ea" exitCode=0 Sep 10 17:41:31.787836 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.787792 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" event={"ID":"88d230c2-1d67-4a64-8756-4462519b2d7c","Type":"ContainerDied","Data":"0c7a08f084d681d6d484a90c85dd55ab91488ff6b9406bc38ae45651f8cd60ea"} Sep 10 17:41:31.840307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.840281 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:31.867741 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:31.867713 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:41:32.004918 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.004885 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jbcw\" (UniqueName: \"kubernetes.io/projected/88d230c2-1d67-4a64-8756-4462519b2d7c-kube-api-access-8jbcw\") pod \"88d230c2-1d67-4a64-8756-4462519b2d7c\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " Sep 10 17:41:32.005081 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.004945 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d230c2-1d67-4a64-8756-4462519b2d7c-plugins-config-volume\") pod \"88d230c2-1d67-4a64-8756-4462519b2d7c\" (UID: \"88d230c2-1d67-4a64-8756-4462519b2d7c\") " Sep 10 17:41:32.005310 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.005288 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88d230c2-1d67-4a64-8756-4462519b2d7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88d230c2-1d67-4a64-8756-4462519b2d7c" (UID: "88d230c2-1d67-4a64-8756-4462519b2d7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:41:32.007229 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.007205 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d230c2-1d67-4a64-8756-4462519b2d7c-kube-api-access-8jbcw" (OuterVolumeSpecName: "kube-api-access-8jbcw") pod "88d230c2-1d67-4a64-8756-4462519b2d7c" (UID: "88d230c2-1d67-4a64-8756-4462519b2d7c"). InnerVolumeSpecName "kube-api-access-8jbcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:41:32.106073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.106010 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jbcw\" (UniqueName: \"kubernetes.io/projected/88d230c2-1d67-4a64-8756-4462519b2d7c-kube-api-access-8jbcw\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:32.106073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.106033 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d230c2-1d67-4a64-8756-4462519b2d7c-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:41:32.126668 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.126625 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:32.794243 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.794223 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" Sep 10 17:41:32.794622 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.794258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97" event={"ID":"88d230c2-1d67-4a64-8756-4462519b2d7c","Type":"ContainerDied","Data":"233b21b8861d391b052e800797df2a34aebf7441eebbb214c64cb476b2bf7174"} Sep 10 17:41:32.794622 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.794316 2580 scope.go:117] "RemoveContainer" containerID="0c7a08f084d681d6d484a90c85dd55ab91488ff6b9406bc38ae45651f8cd60ea" Sep 10 17:41:32.816224 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.816203 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97"] Sep 10 17:41:32.821863 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:32.821838 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97"] Sep 10 17:41:33.436291 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:33.436264 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56ecd146-e76e-4331-a963-9417926d5bb0" path="/var/lib/kubelet/pods/56ecd146-e76e-4331-a963-9417926d5bb0/volumes" Sep 10 17:41:33.436692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:33.436673 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d230c2-1d67-4a64-8756-4462519b2d7c" path="/var/lib/kubelet/pods/88d230c2-1d67-4a64-8756-4462519b2d7c/volumes" Sep 10 17:41:36.490583 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:36.490548 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:36.603793 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:36.603767 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:37.405145 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.405121 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:37.692280 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692205 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k"] Sep 10 17:41:37.692721 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692702 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ecd146-e76e-4331-a963-9417926d5bb0" containerName="revoke-keys" Sep 10 17:41:37.692801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692723 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ecd146-e76e-4331-a963-9417926d5bb0" containerName="revoke-keys" Sep 10 17:41:37.692801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692765 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951ba62b-27d9-487b-b282-46826f0559dd" containerName="istio-proxy" Sep 10 17:41:37.692801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692775 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="951ba62b-27d9-487b-b282-46826f0559dd" containerName="istio-proxy" Sep 10 17:41:37.692801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692792 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" Sep 10 17:41:37.692801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692800 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692809 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692819 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692827 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d230c2-1d67-4a64-8756-4462519b2d7c" containerName="payload-processing" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692836 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d230c2-1d67-4a64-8756-4462519b2d7c" containerName="payload-processing" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692921 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d230c2-1d67-4a64-8756-4462519b2d7c" containerName="payload-processing" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692935 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ecd146-e76e-4331-a963-9417926d5bb0" containerName="revoke-keys" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692943 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="951ba62b-27d9-487b-b282-46826f0559dd" containerName="istio-proxy" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692952 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" Sep 10 17:41:37.693045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.692961 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a837079-d53c-48ed-ac43-c02741bb90ef" containerName="istio-proxy" Sep 10 17:41:37.697405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.697387 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.699582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.699563 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-c990a5-openshift-default-dockercfg-hqcms\"" Sep 10 17:41:37.707277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.707256 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k"] Sep 10 17:41:37.715710 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.715687 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:37.845031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.844997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-podinfo\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-socket\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-credential-socket\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istiod-ca-cert\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-envoy\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46zdk\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-kube-api-access-46zdk\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-token\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845376 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845220 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-certs\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.845376 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.845341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-data\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.898392 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.898362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:37.946589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-data\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-podinfo\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-socket\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-credential-socket\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istiod-ca-cert\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-envoy\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46zdk\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-kube-api-access-46zdk\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-token\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.946958 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-certs\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.947200 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.946961 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-data\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.947200 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.947180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-certs\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.947742 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.947415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-socket\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.947856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.947736 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-credential-socket\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.947919 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.947876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istiod-ca-cert\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.950454 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.950433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-envoy\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.950620 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.950600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-podinfo\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.956584 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.956559 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-token\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:37.956691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:37.956593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46zdk\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-kube-api-access-46zdk\") pod \"e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:38.009259 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.009241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:38.284523 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.284492 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k"] Sep 10 17:41:38.287006 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:41:38.286979 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd3b0c1_a168_4bd9_ad64_46d431f75a94.slice/crio-9ec279312fda91bab2ee451d4304e974230e9eb52973f5c92fc64f07932fe5c5 WatchSource:0}: Error finding container 9ec279312fda91bab2ee451d4304e974230e9eb52973f5c92fc64f07932fe5c5: Status 404 returned error can't find the container with id 9ec279312fda91bab2ee451d4304e974230e9eb52973f5c92fc64f07932fe5c5 Sep 10 17:41:38.289249 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.289214 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:38.289336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.289294 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:38.289387 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.289335 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:38.530576 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.530541 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:38.632493 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.632405 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:38.779412 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.779380 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:38.835599 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.835560 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" event={"ID":"bfd3b0c1-a168-4bd9-ad64-46d431f75a94","Type":"ContainerStarted","Data":"9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785"} Sep 10 17:41:38.835771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.835672 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" event={"ID":"bfd3b0c1-a168-4bd9-ad64-46d431f75a94","Type":"ContainerStarted","Data":"9ec279312fda91bab2ee451d4304e974230e9eb52973f5c92fc64f07932fe5c5"} Sep 10 17:41:38.862899 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:38.862836 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podStartSLOduration=1.8628164219999999 podStartE2EDuration="1.862816422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:38.861218921 +0000 UTC m=+1065.881146075" watchObservedRunningTime="2026-09-10 17:41:38.862816422 +0000 UTC m=+1065.882743573" Sep 10 17:41:39.009582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.009552 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:39.014362 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.014336 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:39.304354 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.304272 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:39.580424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.580350 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc"] Sep 10 17:41:39.583978 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.583958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.586217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.586193 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-058069-openshift-default-dockercfg-s8tm7\"" Sep 10 17:41:39.595750 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.595705 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc"] Sep 10 17:41:39.616121 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.616096 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:39.766271 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istiod-ca-cert\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766432 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-socket\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766432 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-data\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766432 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-credential-socket\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766432 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-envoy\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766562 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-token\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766562 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp9ds\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-kube-api-access-tp9ds\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766562 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-certs\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.766698 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.766594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-podinfo\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.841630 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.841568 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:39.842394 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.842378 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:39.865860 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.865824 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:39.867819 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.867801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-credential-socket\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.867913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.867827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-envoy\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.867913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.867846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-token\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.867913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.867896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp9ds\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-kube-api-access-tp9ds\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868074 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.867920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-certs\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868074 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.867949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-podinfo\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868074 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.867999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istiod-ca-cert\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868074 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.868040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-socket\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868281 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.868087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-data\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868281 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.868212 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-credential-socket\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868398 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.868374 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-certs\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868485 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.868427 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-data\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.868661 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-socket\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.868974 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.868929 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istiod-ca-cert\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.870714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.870629 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-envoy\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.871099 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.871064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-podinfo\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.877206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.877180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-token\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.877439 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.877422 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp9ds\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-kube-api-access-tp9ds\") pod \"e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:39.896416 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:39.896377 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:40.183618 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.183591 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc"] Sep 10 17:41:40.184753 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:41:40.184727 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1596fc_5a4a_4d30_b4c4_16fa0c47dff0.slice/crio-5e09d9cac6a65d1b5456380ac53f850093b33533d4796975ec19c0569aa34d32 WatchSource:0}: Error finding container 5e09d9cac6a65d1b5456380ac53f850093b33533d4796975ec19c0569aa34d32: Status 404 returned error can't find the container with id 5e09d9cac6a65d1b5456380ac53f850093b33533d4796975ec19c0569aa34d32 Sep 10 17:41:40.187112 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.187080 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:40.187198 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.187147 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:40.187198 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.187179 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:40.742829 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.742795 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:40.840178 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.840139 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:40.849483 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.849456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" event={"ID":"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0","Type":"ContainerStarted","Data":"f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da"} Sep 10 17:41:40.849866 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.849520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" event={"ID":"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0","Type":"ContainerStarted","Data":"5e09d9cac6a65d1b5456380ac53f850093b33533d4796975ec19c0569aa34d32"} Sep 10 17:41:40.871484 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.871444 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" podStartSLOduration=1.8714309070000001 podStartE2EDuration="1.871430907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:40.870721699 +0000 UTC m=+1067.890648850" watchObservedRunningTime="2026-09-10 17:41:40.871430907 +0000 UTC m=+1067.891358057" Sep 10 17:41:40.896924 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:40.896900 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:41.901852 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:41.901827 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:42.048832 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.048800 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:42.119505 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.119467 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:42.629202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.629174 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:42.723363 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.723337 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:42.827930 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.827885 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:42.860879 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.860854 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:42.861843 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.861824 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:42.937881 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:42.937789 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:44.059800 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.059771 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:44.125199 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.125168 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:44.515010 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.514944 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:44.634043 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.634001 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:44.735884 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.735850 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:41:44.737683 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.737662 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg"] Sep 10 17:41:44.741184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.741168 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:44.744434 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.744417 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-058069-dockercfg-9k9z7\"" Sep 10 17:41:44.744770 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.744756 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-058069\"" Sep 10 17:41:44.753573 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.753551 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg"] Sep 10 17:41:44.779537 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.779485 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc"] Sep 10 17:41:44.782791 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.782777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:44.795066 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.795041 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc"] Sep 10 17:41:44.824622 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.824599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d685381e-76ac-4c85-9f47-82649554b441-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:44.824752 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.824676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzn7\" (UniqueName: \"kubernetes.io/projected/d685381e-76ac-4c85-9f47-82649554b441-kube-api-access-2hzn7\") pod \"payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:44.925499 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.925470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d685381e-76ac-4c85-9f47-82649554b441-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:44.925731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.925512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzn7\" (UniqueName: \"kubernetes.io/projected/d685381e-76ac-4c85-9f47-82649554b441-kube-api-access-2hzn7\") pod \"payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:44.925731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.925553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76dvq\" (UniqueName: \"kubernetes.io/projected/43530064-f023-4679-8224-0e8fb5a575b1-kube-api-access-76dvq\") pod \"payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:44.925731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.925601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43530064-f023-4679-8224-0e8fb5a575b1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:44.926229 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.926210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d685381e-76ac-4c85-9f47-82649554b441-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:44.934158 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:44.934140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzn7\" (UniqueName: \"kubernetes.io/projected/d685381e-76ac-4c85-9f47-82649554b441-kube-api-access-2hzn7\") pod \"payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:45.026417 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.026386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76dvq\" (UniqueName: \"kubernetes.io/projected/43530064-f023-4679-8224-0e8fb5a575b1-kube-api-access-76dvq\") pod \"payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:45.026560 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.026438 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43530064-f023-4679-8224-0e8fb5a575b1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:45.027084 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.027064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43530064-f023-4679-8224-0e8fb5a575b1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:45.035040 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.034989 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76dvq\" (UniqueName: \"kubernetes.io/projected/43530064-f023-4679-8224-0e8fb5a575b1-kube-api-access-76dvq\") pod \"payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:45.050653 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.050625 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:45.091803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.091771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:45.335979 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.335956 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg"] Sep 10 17:41:45.337797 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:41:45.337773 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd685381e_76ac_4c85_9f47_82649554b441.slice/crio-7b21fac12c8286707ecdd1d114d0492557c0f01632f2346035a8e28e44880b97 WatchSource:0}: Error finding container 7b21fac12c8286707ecdd1d114d0492557c0f01632f2346035a8e28e44880b97: Status 404 returned error can't find the container with id 7b21fac12c8286707ecdd1d114d0492557c0f01632f2346035a8e28e44880b97 Sep 10 17:41:45.375934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.375909 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc"] Sep 10 17:41:45.384538 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:41:45.384514 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43530064_f023_4679_8224_0e8fb5a575b1.slice/crio-f6e77d4d155226dc4cf8899ec1e6563a49f81981f3d96838b1f80fb3247eaeac WatchSource:0}: Error finding container f6e77d4d155226dc4cf8899ec1e6563a49f81981f3d96838b1f80fb3247eaeac: Status 404 returned error can't find the container with id f6e77d4d155226dc4cf8899ec1e6563a49f81981f3d96838b1f80fb3247eaeac Sep 10 17:41:45.880176 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.880141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" event={"ID":"43530064-f023-4679-8224-0e8fb5a575b1","Type":"ContainerStarted","Data":"834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d"} Sep 10 17:41:45.880352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.880202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" event={"ID":"43530064-f023-4679-8224-0e8fb5a575b1","Type":"ContainerStarted","Data":"f6e77d4d155226dc4cf8899ec1e6563a49f81981f3d96838b1f80fb3247eaeac"} Sep 10 17:41:45.880352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.880255 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:45.881777 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.881753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" event={"ID":"d685381e-76ac-4c85-9f47-82649554b441","Type":"ContainerStarted","Data":"d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078"} Sep 10 17:41:45.881900 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.881799 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:45.881900 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.881815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" event={"ID":"d685381e-76ac-4c85-9f47-82649554b441","Type":"ContainerStarted","Data":"7b21fac12c8286707ecdd1d114d0492557c0f01632f2346035a8e28e44880b97"} Sep 10 17:41:45.900219 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.900142 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" podStartSLOduration=1.9001249690000002 podStartE2EDuration="1.900124969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:45.899586615 +0000 UTC m=+1072.919513766" watchObservedRunningTime="2026-09-10 17:41:45.900124969 +0000 UTC m=+1072.920052132" Sep 10 17:41:45.918755 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:45.918706 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" podStartSLOduration=1.918688647 podStartE2EDuration="1.918688647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:45.916679054 +0000 UTC m=+1072.936606216" watchObservedRunningTime="2026-09-10 17:41:45.918688647 +0000 UTC m=+1072.938615800" Sep 10 17:41:55.882810 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:55.882762 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 10 17:41:55.883272 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:55.882819 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 10 17:41:56.889906 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.889827 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:41:56.889906 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.889902 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:41:56.959337 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.959295 2580 generic.go:356] "Generic (PLEG): container finished" podID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerID="9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785" exitCode=0 Sep 10 17:41:56.959519 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.959373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" event={"ID":"bfd3b0c1-a168-4bd9-ad64-46d431f75a94","Type":"ContainerDied","Data":"9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785"} Sep 10 17:41:56.959911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.959890 2580 scope.go:117] "RemoveContainer" containerID="9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785" Sep 10 17:41:56.961079 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.961048 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:56.961161 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.961121 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:56.961161 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:56.961154 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:57.862172 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.862139 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Sep 10 17:41:57.862376 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.862189 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Sep 10 17:41:57.966537 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.966509 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerID="f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da" exitCode=0 Sep 10 17:41:57.967028 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.966594 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" event={"ID":"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0","Type":"ContainerDied","Data":"f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da"} Sep 10 17:41:57.967084 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.967042 2580 scope.go:117] "RemoveContainer" containerID="f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da" Sep 10 17:41:57.968867 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.968823 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:57.969154 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.969131 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:57.969345 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.969322 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:41:57.975378 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:57.975344 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" event={"ID":"bfd3b0c1-a168-4bd9-ad64-46d431f75a94","Type":"ContainerStarted","Data":"6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956"} Sep 10 17:41:58.009889 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:58.009862 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:41:58.010058 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:58.010036 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Sep 10 17:41:58.010105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:58.010088 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Sep 10 17:41:58.984317 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:58.984276 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" event={"ID":"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0","Type":"ContainerStarted","Data":"bed4259b72d246226ce32d611a6ad9aaf5e7c17b232a8fc0f6d1970636ae24b5"} Sep 10 17:41:59.010501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:59.010472 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Sep 10 17:41:59.010665 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:59.010540 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Sep 10 17:41:59.897265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:59.897230 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:41:59.897423 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:59.897327 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Sep 10 17:41:59.897423 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:41:59.897371 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Sep 10 17:42:00.010456 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:00.010427 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Sep 10 17:42:00.010837 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:00.010477 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Sep 10 17:42:00.896738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:00.896699 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Sep 10 17:42:00.896918 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:00.896755 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Sep 10 17:42:01.009970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:01.009941 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Sep 10 17:42:01.010135 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:01.009993 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Sep 10 17:42:01.848098 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:01.848045 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:01.896916 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:01.896885 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Sep 10 17:42:01.897100 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:01.896946 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Sep 10 17:42:02.010476 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:02.010450 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Sep 10 17:42:02.010775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:02.010691 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Sep 10 17:42:02.897580 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:02.897547 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Sep 10 17:42:02.897961 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:02.897600 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Sep 10 17:42:03.013219 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:03.013191 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:42:03.013535 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:03.013516 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:42:03.014089 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:03.014071 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:42:03.145986 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:03.145941 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:03.901143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:03.901116 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:42:03.901507 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:03.901409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:42:03.902047 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:03.902027 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:42:05.013527 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:05.013490 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:05.687504 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:05.687464 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:06.059537 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:06.059508 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:06.357892 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:06.357824 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:06.530932 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:06.530894 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:07.658950 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:07.658919 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:07.985190 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:07.985164 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:08.292779 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:08.292695 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:09.230919 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:09.230883 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:09.329354 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:09.329327 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:09.496336 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:09.496265 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:10.533909 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:10.533868 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:10.654775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:10.654740 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:10.805188 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:10.805106 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:11.040980 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.040895 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:11.129054 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.128977 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:11.134744 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.134721 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph"] Sep 10 17:42:11.137836 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.137819 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.141001 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.140984 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-762738\"" Sep 10 17:42:11.155186 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.155166 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph"] Sep 10 17:42:11.273204 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.273173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f06d399-7dfe-430b-818b-c5fc1f7f3180-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.273409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.273276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lp5q\" (UniqueName: \"kubernetes.io/projected/7f06d399-7dfe-430b-818b-c5fc1f7f3180-kube-api-access-8lp5q\") pod \"payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.373973 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.373941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lp5q\" (UniqueName: \"kubernetes.io/projected/7f06d399-7dfe-430b-818b-c5fc1f7f3180-kube-api-access-8lp5q\") pod \"payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.374123 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.374039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f06d399-7dfe-430b-818b-c5fc1f7f3180-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.374742 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.374725 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f06d399-7dfe-430b-818b-c5fc1f7f3180-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.383029 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.382968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lp5q\" (UniqueName: \"kubernetes.io/projected/7f06d399-7dfe-430b-818b-c5fc1f7f3180-kube-api-access-8lp5q\") pod \"payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.447578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.447553 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:11.573603 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.573565 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:11.660771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.660708 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:11.721888 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:11.721867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph"] Sep 10 17:42:11.723133 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:42:11.723111 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f06d399_7dfe_430b_818b_c5fc1f7f3180.slice/crio-edeb8e15bf61032c4824984315eee58312f574b8b57187d777082401098ae379 WatchSource:0}: Error finding container edeb8e15bf61032c4824984315eee58312f574b8b57187d777082401098ae379: Status 404 returned error can't find the container with id edeb8e15bf61032c4824984315eee58312f574b8b57187d777082401098ae379 Sep 10 17:42:12.063356 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:12.063325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" event={"ID":"7f06d399-7dfe-430b-818b-c5fc1f7f3180","Type":"ContainerStarted","Data":"7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3"} Sep 10 17:42:12.063523 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:12.063375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" event={"ID":"7f06d399-7dfe-430b-818b-c5fc1f7f3180","Type":"ContainerStarted","Data":"edeb8e15bf61032c4824984315eee58312f574b8b57187d777082401098ae379"} Sep 10 17:42:12.063523 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:12.063408 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:12.080959 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:12.080916 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" podStartSLOduration=1.080900008 podStartE2EDuration="1.080900008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:12.079015801 +0000 UTC m=+1099.098942952" watchObservedRunningTime="2026-09-10 17:42:12.080900008 +0000 UTC m=+1099.100827187" Sep 10 17:42:12.736797 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:12.736764 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:12.838725 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:12.838688 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:13.279172 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.279128 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:13.375383 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.375355 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:13.391308 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.391271 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw"] Sep 10 17:42:13.393860 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.393844 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.397785 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.397768 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-4f14bf\"" Sep 10 17:42:13.407858 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.407837 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw"] Sep 10 17:42:13.414999 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.414977 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj"] Sep 10 17:42:13.417242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.417224 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.421489 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.421465 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-4f14bf-dockercfg-jphj4\"" Sep 10 17:42:13.432620 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.432596 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj"] Sep 10 17:42:13.492178 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.492153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5h7m\" (UniqueName: \"kubernetes.io/projected/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-kube-api-access-n5h7m\") pod \"payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.492277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.492188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6c4p\" (UniqueName: \"kubernetes.io/projected/a6696ec4-420e-49ec-85f8-6e528690f7b8-kube-api-access-t6c4p\") pod \"payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.492277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.492233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.492277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.492256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6696ec4-420e-49ec-85f8-6e528690f7b8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.593772 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.593685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.593772 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.593734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6696ec4-420e-49ec-85f8-6e528690f7b8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.594002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.593796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5h7m\" (UniqueName: \"kubernetes.io/projected/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-kube-api-access-n5h7m\") pod \"payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.594002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.593823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6c4p\" (UniqueName: \"kubernetes.io/projected/a6696ec4-420e-49ec-85f8-6e528690f7b8-kube-api-access-t6c4p\") pod \"payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.594461 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.594442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6696ec4-420e-49ec-85f8-6e528690f7b8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.594503 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.594442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.601803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.601773 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5h7m\" (UniqueName: \"kubernetes.io/projected/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-kube-api-access-n5h7m\") pod \"payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.602033 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.602014 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6c4p\" (UniqueName: \"kubernetes.io/projected/a6696ec4-420e-49ec-85f8-6e528690f7b8-kube-api-access-t6c4p\") pod \"payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.703962 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.703938 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:13.727443 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.727423 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:13.983015 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:13.982990 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw"] Sep 10 17:42:13.984342 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:42:13.984313 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9035cd_660a_4f00_a4cd_f1e00ec6b199.slice/crio-49ff5a1c8bfe40a097c41eadc33abea2a77150baaa76a868ac633f7389047085 WatchSource:0}: Error finding container 49ff5a1c8bfe40a097c41eadc33abea2a77150baaa76a868ac633f7389047085: Status 404 returned error can't find the container with id 49ff5a1c8bfe40a097c41eadc33abea2a77150baaa76a868ac633f7389047085 Sep 10 17:42:14.011129 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.011109 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj"] Sep 10 17:42:14.013702 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:42:14.013677 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6696ec4_420e_49ec_85f8_6e528690f7b8.slice/crio-b3ff902f9bae8e48969c416d5654fd29cfab27926d2988e0c275ab03d5676539 WatchSource:0}: Error finding container b3ff902f9bae8e48969c416d5654fd29cfab27926d2988e0c275ab03d5676539: Status 404 returned error can't find the container with id b3ff902f9bae8e48969c416d5654fd29cfab27926d2988e0c275ab03d5676539 Sep 10 17:42:14.076820 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.076789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" event={"ID":"a6696ec4-420e-49ec-85f8-6e528690f7b8","Type":"ContainerStarted","Data":"88c90c397d593c5180e6dfda6092a3183619b11c46ab6ef2867eef1d88907fc4"} Sep 10 17:42:14.076954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.076855 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:14.076954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.076877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" event={"ID":"a6696ec4-420e-49ec-85f8-6e528690f7b8","Type":"ContainerStarted","Data":"b3ff902f9bae8e48969c416d5654fd29cfab27926d2988e0c275ab03d5676539"} Sep 10 17:42:14.078523 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.078497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" event={"ID":"3b9035cd-660a-4f00-a4cd-f1e00ec6b199","Type":"ContainerStarted","Data":"3059375cbaa6e98d99d35bf8da04ef8e086473a9f2534a99e2e365464b350427"} Sep 10 17:42:14.078633 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.078543 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" event={"ID":"3b9035cd-660a-4f00-a4cd-f1e00ec6b199","Type":"ContainerStarted","Data":"49ff5a1c8bfe40a097c41eadc33abea2a77150baaa76a868ac633f7389047085"} Sep 10 17:42:14.078633 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.078591 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:14.092839 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.092783 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" podStartSLOduration=1.092766977 podStartE2EDuration="1.092766977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:14.092514537 +0000 UTC m=+1101.112441701" watchObservedRunningTime="2026-09-10 17:42:14.092766977 +0000 UTC m=+1101.112694128" Sep 10 17:42:14.108917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:14.108859 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" podStartSLOduration=1.108834542 podStartE2EDuration="1.108834542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:14.108385036 +0000 UTC m=+1101.128312188" watchObservedRunningTime="2026-09-10 17:42:14.108834542 +0000 UTC m=+1101.128761692" Sep 10 17:42:23.070967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:23.070939 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:42:25.086753 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:25.086724 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:42:25.087202 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:25.086784 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:42:31.430358 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:31.430322 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:33.675613 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:33.675582 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:34.201533 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:34.201488 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:36.244352 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:36.244314 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:42.899146 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:42.899112 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:45.781771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:45.781742 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:46.074366 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:46.074281 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:46.218938 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:46.218882 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:46.436568 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:46.436467 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:49.509429 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:49.509398 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:49.601252 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:49.601227 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:50.650500 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:50.650463 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:50.753272 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:50.753217 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:51.025267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.025240 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:51.350714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.350610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:51.456071 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.456039 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:42:51.545572 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.545544 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw"] Sep 10 17:42:51.548058 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.548038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.550085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.550062 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1407ad96\"" Sep 10 17:42:51.550198 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.550181 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1407ad96-dockercfg-64bmq\"" Sep 10 17:42:51.562839 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.562819 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw"] Sep 10 17:42:51.608407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.608146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57e46fd7-7f20-4766-b80a-2945b92b0f49-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.608407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.608293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkws5\" (UniqueName: \"kubernetes.io/projected/57e46fd7-7f20-4766-b80a-2945b92b0f49-kube-api-access-bkws5\") pod \"payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.621879 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.621844 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn"] Sep 10 17:42:51.624454 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.624436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:51.637010 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.636986 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn"] Sep 10 17:42:51.709389 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.709367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkws5\" (UniqueName: \"kubernetes.io/projected/57e46fd7-7f20-4766-b80a-2945b92b0f49-kube-api-access-bkws5\") pod \"payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.709735 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.709407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwx4r\" (UniqueName: \"kubernetes.io/projected/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-kube-api-access-pwx4r\") pod \"payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:51.709735 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.709446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57e46fd7-7f20-4766-b80a-2945b92b0f49-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.709735 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.709502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-plugins-config-volume\") pod \"payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:51.710110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.710091 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57e46fd7-7f20-4766-b80a-2945b92b0f49-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.717499 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.717481 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkws5\" (UniqueName: \"kubernetes.io/projected/57e46fd7-7f20-4766-b80a-2945b92b0f49-kube-api-access-bkws5\") pod \"payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.810994 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.810970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-plugins-config-volume\") pod \"payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:51.811083 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.811043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwx4r\" (UniqueName: \"kubernetes.io/projected/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-kube-api-access-pwx4r\") pod \"payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:51.811565 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.811547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-plugins-config-volume\") pod \"payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:51.822452 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.822434 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwx4r\" (UniqueName: \"kubernetes.io/projected/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-kube-api-access-pwx4r\") pod \"payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:51.858360 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.858336 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:51.933907 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:51.933880 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:52.130550 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.130526 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw"] Sep 10 17:42:52.131306 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:42:52.131282 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e46fd7_7f20_4766_b80a_2945b92b0f49.slice/crio-f37d3ad1bebf63c0957711794455c3bd03b348f47edfc398d972d5274ea22c47 WatchSource:0}: Error finding container f37d3ad1bebf63c0957711794455c3bd03b348f47edfc398d972d5274ea22c47: Status 404 returned error can't find the container with id f37d3ad1bebf63c0957711794455c3bd03b348f47edfc398d972d5274ea22c47 Sep 10 17:42:52.209006 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.208978 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn"] Sep 10 17:42:52.209886 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:42:52.209856 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c56e6a_0d9e_4458_a24d_ffd18ced7a79.slice/crio-0e7afbb31d41bd8f46a4f5c569485b34f70925dbb44bf9fbb29ff676379e74d8 WatchSource:0}: Error finding container 0e7afbb31d41bd8f46a4f5c569485b34f70925dbb44bf9fbb29ff676379e74d8: Status 404 returned error can't find the container with id 0e7afbb31d41bd8f46a4f5c569485b34f70925dbb44bf9fbb29ff676379e74d8 Sep 10 17:42:52.294375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.294343 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" event={"ID":"57e46fd7-7f20-4766-b80a-2945b92b0f49","Type":"ContainerStarted","Data":"004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b"} Sep 10 17:42:52.294489 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.294399 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" event={"ID":"57e46fd7-7f20-4766-b80a-2945b92b0f49","Type":"ContainerStarted","Data":"f37d3ad1bebf63c0957711794455c3bd03b348f47edfc398d972d5274ea22c47"} Sep 10 17:42:52.294556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.294515 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:42:52.296185 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.296164 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" event={"ID":"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79","Type":"ContainerStarted","Data":"b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30"} Sep 10 17:42:52.296277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.296208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" event={"ID":"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79","Type":"ContainerStarted","Data":"0e7afbb31d41bd8f46a4f5c569485b34f70925dbb44bf9fbb29ff676379e74d8"} Sep 10 17:42:52.296277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.296246 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:42:52.314251 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.314209 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" podStartSLOduration=1.314194847 podStartE2EDuration="1.314194847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:52.311330116 +0000 UTC m=+1139.331257268" watchObservedRunningTime="2026-09-10 17:42:52.314194847 +0000 UTC m=+1139.334121998" Sep 10 17:42:52.328848 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:42:52.328803 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" podStartSLOduration=1.3287860519999999 podStartE2EDuration="1.328786052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:52.327166871 +0000 UTC m=+1139.347094047" watchObservedRunningTime="2026-09-10 17:42:52.328786052 +0000 UTC m=+1139.348713205" Sep 10 17:43:01.330440 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:43:01.330408 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:03.303427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:43:03.303397 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:43:03.303830 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:43:03.303623 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:43:14.468246 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:43:14.468165 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:27.316967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:43:27.316933 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:27.375359 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:43:27.375331 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:49.214144 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:43:49.214103 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:00.728657 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:00.728619 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:15.047900 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:15.047859 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:16.969989 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:16.969948 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:30.385409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.385375 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:30.411875 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.411847 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn"] Sep 10 17:44:30.412080 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.412043 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" podUID="a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" containerName="payload-processing" containerID="cri-o://b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30" gracePeriod=30 Sep 10 17:44:30.421882 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.421857 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw"] Sep 10 17:44:30.422060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.422042 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" podUID="57e46fd7-7f20-4766-b80a-2945b92b0f49" containerName="payload-pre-processing" containerID="cri-o://004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b" gracePeriod=30 Sep 10 17:44:30.454425 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.454334 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:30.536698 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.536668 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:30.686269 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.686240 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:44:30.703481 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.703458 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:30.710931 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.710914 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:44:30.830312 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830283 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwx4r\" (UniqueName: \"kubernetes.io/projected/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-kube-api-access-pwx4r\") pod \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " Sep 10 17:44:30.830451 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830341 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkws5\" (UniqueName: \"kubernetes.io/projected/57e46fd7-7f20-4766-b80a-2945b92b0f49-kube-api-access-bkws5\") pod \"57e46fd7-7f20-4766-b80a-2945b92b0f49\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " Sep 10 17:44:30.830501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830454 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57e46fd7-7f20-4766-b80a-2945b92b0f49-plugins-config-volume\") pod \"57e46fd7-7f20-4766-b80a-2945b92b0f49\" (UID: \"57e46fd7-7f20-4766-b80a-2945b92b0f49\") " Sep 10 17:44:30.830561 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830546 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-plugins-config-volume\") pod \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\" (UID: \"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79\") " Sep 10 17:44:30.830834 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830812 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e46fd7-7f20-4766-b80a-2945b92b0f49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57e46fd7-7f20-4766-b80a-2945b92b0f49" (UID: "57e46fd7-7f20-4766-b80a-2945b92b0f49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:44:30.830934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830872 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" (UID: "a0c56e6a-0d9e-4458-a24d-ffd18ced7a79"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:44:30.830987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830952 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57e46fd7-7f20-4766-b80a-2945b92b0f49-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:44:30.830987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.830966 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:44:30.832574 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.832556 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e46fd7-7f20-4766-b80a-2945b92b0f49-kube-api-access-bkws5" (OuterVolumeSpecName: "kube-api-access-bkws5") pod "57e46fd7-7f20-4766-b80a-2945b92b0f49" (UID: "57e46fd7-7f20-4766-b80a-2945b92b0f49"). InnerVolumeSpecName "kube-api-access-bkws5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:44:30.832625 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.832579 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-kube-api-access-pwx4r" (OuterVolumeSpecName: "kube-api-access-pwx4r") pod "a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" (UID: "a0c56e6a-0d9e-4458-a24d-ffd18ced7a79"). InnerVolumeSpecName "kube-api-access-pwx4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:44:30.839930 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.839906 2580 generic.go:356] "Generic (PLEG): container finished" podID="57e46fd7-7f20-4766-b80a-2945b92b0f49" containerID="004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b" exitCode=0 Sep 10 17:44:30.840031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.839959 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" Sep 10 17:44:30.840031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.839985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" event={"ID":"57e46fd7-7f20-4766-b80a-2945b92b0f49","Type":"ContainerDied","Data":"004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b"} Sep 10 17:44:30.840142 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.840087 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw" event={"ID":"57e46fd7-7f20-4766-b80a-2945b92b0f49","Type":"ContainerDied","Data":"f37d3ad1bebf63c0957711794455c3bd03b348f47edfc398d972d5274ea22c47"} Sep 10 17:44:30.840142 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.840122 2580 scope.go:117] "RemoveContainer" containerID="004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b" Sep 10 17:44:30.841380 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.841359 2580 generic.go:356] "Generic (PLEG): container finished" podID="a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" containerID="b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30" exitCode=0 Sep 10 17:44:30.841470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.841398 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" Sep 10 17:44:30.841470 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.841451 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" event={"ID":"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79","Type":"ContainerDied","Data":"b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30"} Sep 10 17:44:30.841569 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.841494 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn" event={"ID":"a0c56e6a-0d9e-4458-a24d-ffd18ced7a79","Type":"ContainerDied","Data":"0e7afbb31d41bd8f46a4f5c569485b34f70925dbb44bf9fbb29ff676379e74d8"} Sep 10 17:44:30.857847 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.857828 2580 scope.go:117] "RemoveContainer" containerID="004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b" Sep 10 17:44:30.858151 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:44:30.858134 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b\": container with ID starting with 004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b not found: ID does not exist" containerID="004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b" Sep 10 17:44:30.858220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.858158 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b"} err="failed to get container status \"004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b\": rpc error: code = NotFound desc = could not find container \"004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b\": container with ID starting with 004e531a97e24e88979db4ff41f33dfe6f1dffcc69c693a99b31a4ec0075438b not found: ID does not exist" Sep 10 17:44:30.858220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.858175 2580 scope.go:117] "RemoveContainer" containerID="b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30" Sep 10 17:44:30.866712 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.866695 2580 scope.go:117] "RemoveContainer" containerID="b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30" Sep 10 17:44:30.866971 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:44:30.866953 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30\": container with ID starting with b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30 not found: ID does not exist" containerID="b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30" Sep 10 17:44:30.867032 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.866975 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30"} err="failed to get container status \"b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30\": rpc error: code = NotFound desc = could not find container \"b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30\": container with ID starting with b71adf40d676e3ffaa7cef65133749a5ac940cb3d59bd8597005edb4844e5a30 not found: ID does not exist" Sep 10 17:44:30.877669 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.877649 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw"] Sep 10 17:44:30.882138 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.882118 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw"] Sep 10 17:44:30.892423 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.892403 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn"] Sep 10 17:44:30.895978 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.895959 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn"] Sep 10 17:44:30.932177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.932127 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwx4r\" (UniqueName: \"kubernetes.io/projected/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79-kube-api-access-pwx4r\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:44:30.932177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:30.932147 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkws5\" (UniqueName: \"kubernetes.io/projected/57e46fd7-7f20-4766-b80a-2945b92b0f49-kube-api-access-bkws5\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:44:31.432427 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:31.432402 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e46fd7-7f20-4766-b80a-2945b92b0f49" path="/var/lib/kubelet/pods/57e46fd7-7f20-4766-b80a-2945b92b0f49/volumes" Sep 10 17:44:31.432773 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:31.432759 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" path="/var/lib/kubelet/pods/a0c56e6a-0d9e-4458-a24d-ffd18ced7a79/volumes" Sep 10 17:44:33.841068 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:33.841041 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:38.881613 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:44:38.881577 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:00.140813 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.140782 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t"] Sep 10 17:45:00.141174 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.141161 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e46fd7-7f20-4766-b80a-2945b92b0f49" containerName="payload-pre-processing" Sep 10 17:45:00.141217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.141175 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e46fd7-7f20-4766-b80a-2945b92b0f49" containerName="payload-pre-processing" Sep 10 17:45:00.141217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.141183 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" containerName="payload-processing" Sep 10 17:45:00.141217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.141188 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" containerName="payload-processing" Sep 10 17:45:00.141314 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.141242 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c56e6a-0d9e-4458-a24d-ffd18ced7a79" containerName="payload-processing" Sep 10 17:45:00.141314 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.141254 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e46fd7-7f20-4766-b80a-2945b92b0f49" containerName="payload-pre-processing" Sep 10 17:45:00.145590 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.145568 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm"] Sep 10 17:45:00.145719 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.145703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" Sep 10 17:45:00.147992 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.147972 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-77v6x\"" Sep 10 17:45:00.148102 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.148086 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" Sep 10 17:45:00.158113 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.158091 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t"] Sep 10 17:45:00.160029 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.160003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" Sep 10 17:45:00.163056 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.163039 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm"] Sep 10 17:45:00.166977 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.166955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" Sep 10 17:45:00.446471 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.446445 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm"] Sep 10 17:45:00.447775 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:45:00.447669 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0b6768_9b74_42e2_81a2_f06980e21b6f.slice/crio-4fd1418fbad3bc90e88a50137e70bf1c441cf21fa0f4ebd9812dabd57f317c9e WatchSource:0}: Error finding container 4fd1418fbad3bc90e88a50137e70bf1c441cf21fa0f4ebd9812dabd57f317c9e: Status 404 returned error can't find the container with id 4fd1418fbad3bc90e88a50137e70bf1c441cf21fa0f4ebd9812dabd57f317c9e Sep 10 17:45:00.449151 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:00.449123 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t"] Sep 10 17:45:00.449958 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:45:00.449939 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d2e596_c8fd_4e83_bcc1_3b5d61f7a71e.slice/crio-6fc3b94b7b24bda8b441836c330b845499e8a8ef292a56994e01df6ba762dc1b WatchSource:0}: Error finding container 6fc3b94b7b24bda8b441836c330b845499e8a8ef292a56994e01df6ba762dc1b: Status 404 returned error can't find the container with id 6fc3b94b7b24bda8b441836c330b845499e8a8ef292a56994e01df6ba762dc1b Sep 10 17:45:01.009708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:01.009627 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" event={"ID":"c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e","Type":"ContainerStarted","Data":"d99ad07a1e78c3bfaff91ca004de0808338b1a747b3b7d783523e5b926167c6e"} Sep 10 17:45:01.009708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:01.009697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" event={"ID":"c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e","Type":"ContainerStarted","Data":"6fc3b94b7b24bda8b441836c330b845499e8a8ef292a56994e01df6ba762dc1b"} Sep 10 17:45:01.011228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:01.011208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" event={"ID":"8b0b6768-9b74-42e2-81a2-f06980e21b6f","Type":"ContainerStarted","Data":"31f77d2434e17b5eadc0f0d9a23c86b09ea743f7b2f24c2cf77fbb611e8e1ab6"} Sep 10 17:45:01.011323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:01.011251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" event={"ID":"8b0b6768-9b74-42e2-81a2-f06980e21b6f","Type":"ContainerStarted","Data":"4fd1418fbad3bc90e88a50137e70bf1c441cf21fa0f4ebd9812dabd57f317c9e"} Sep 10 17:45:01.026240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:01.026196 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" podStartSLOduration=1.026183109 podStartE2EDuration="1.026183109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:45:01.024655944 +0000 UTC m=+1268.044583089" watchObservedRunningTime="2026-09-10 17:45:01.026183109 +0000 UTC m=+1268.046110260" Sep 10 17:45:01.041140 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:01.041102 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" podStartSLOduration=1.041087587 podStartE2EDuration="1.041087587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:45:01.039143934 +0000 UTC m=+1268.059071084" watchObservedRunningTime="2026-09-10 17:45:01.041087587 +0000 UTC m=+1268.061014738" Sep 10 17:45:02.018482 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:02.018450 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b0b6768-9b74-42e2-81a2-f06980e21b6f" containerID="31f77d2434e17b5eadc0f0d9a23c86b09ea743f7b2f24c2cf77fbb611e8e1ab6" exitCode=0 Sep 10 17:45:02.018855 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:02.018530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" event={"ID":"8b0b6768-9b74-42e2-81a2-f06980e21b6f","Type":"ContainerDied","Data":"31f77d2434e17b5eadc0f0d9a23c86b09ea743f7b2f24c2cf77fbb611e8e1ab6"} Sep 10 17:45:02.020053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:02.020028 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e" containerID="d99ad07a1e78c3bfaff91ca004de0808338b1a747b3b7d783523e5b926167c6e" exitCode=0 Sep 10 17:45:02.020154 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:02.020081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" event={"ID":"c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e","Type":"ContainerDied","Data":"d99ad07a1e78c3bfaff91ca004de0808338b1a747b3b7d783523e5b926167c6e"} Sep 10 17:45:03.154405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:03.154380 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" Sep 10 17:45:03.195090 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:03.195064 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" Sep 10 17:45:04.032184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:04.032157 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" Sep 10 17:45:04.032328 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:04.032195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm" event={"ID":"8b0b6768-9b74-42e2-81a2-f06980e21b6f","Type":"ContainerDied","Data":"4fd1418fbad3bc90e88a50137e70bf1c441cf21fa0f4ebd9812dabd57f317c9e"} Sep 10 17:45:04.032328 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:04.032242 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fd1418fbad3bc90e88a50137e70bf1c441cf21fa0f4ebd9812dabd57f317c9e" Sep 10 17:45:04.033498 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:04.033467 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" event={"ID":"c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e","Type":"ContainerDied","Data":"6fc3b94b7b24bda8b441836c330b845499e8a8ef292a56994e01df6ba762dc1b"} Sep 10 17:45:04.033614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:04.033507 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fc3b94b7b24bda8b441836c330b845499e8a8ef292a56994e01df6ba762dc1b" Sep 10 17:45:04.033614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:04.033512 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t" Sep 10 17:45:11.075073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:11.075035 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:12.470525 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:12.470483 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:14.968889 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:14.968836 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:15.954240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:15.954202 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:21.757268 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:21.755438 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:21.856316 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:21.856286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:25.921174 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:25.921141 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:38.330954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:38.330925 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:42.634086 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:42.634049 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:44.766740 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:44.766702 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:44.867424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:44.867389 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:45.050193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:45.050114 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:46.292092 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:46.292058 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:46.391158 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:46.391123 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:46.511399 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:46.511365 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:47.274560 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:47.274526 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:47.396385 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:47.396355 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:48.702180 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:48.702154 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:54.539928 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:54.539890 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:54.609053 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:54.609025 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:55.208974 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:55.208950 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:58.286206 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:45:58.286164 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:01.139004 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:01.138964 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:01.219724 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:01.219697 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:01.313191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:01.313157 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:11.935410 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:11.935375 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:12.170213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:12.170178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:32.875768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:32.875737 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:32.977875 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:32.977846 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:33.132391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:33.132308 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:38.168231 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:38.168200 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:39.183276 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:39.183242 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:39.389247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:39.389211 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:39.451012 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:39.450984 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:39.776888 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:39.776818 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:40.071163 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:40.071093 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:40.655097 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:40.655072 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:42.887708 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:42.887672 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:42.987011 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:42.986981 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:44.208947 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.208920 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:44.309265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.309231 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:44.699690 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.699657 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:44.797546 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.797520 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:44.810369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.810344 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb"] Sep 10 17:46:44.810754 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.810742 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e" containerName="cleanup" Sep 10 17:46:44.810803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.810756 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e" containerName="cleanup" Sep 10 17:46:44.810803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.810763 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0b6768-9b74-42e2-81a2-f06980e21b6f" containerName="cleanup" Sep 10 17:46:44.810803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.810768 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0b6768-9b74-42e2-81a2-f06980e21b6f" containerName="cleanup" Sep 10 17:46:44.810901 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.810839 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e" containerName="cleanup" Sep 10 17:46:44.810901 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.810851 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0b6768-9b74-42e2-81a2-f06980e21b6f" containerName="cleanup" Sep 10 17:46:44.813900 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.813883 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:44.816232 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.816211 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b32e7b\"" Sep 10 17:46:44.816338 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.816317 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b32e7b-dockercfg-2rwpb\"" Sep 10 17:46:44.826693 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.826673 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb"] Sep 10 17:46:44.843605 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.843581 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7"] Sep 10 17:46:44.847682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.847663 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:44.859955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.859935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:44.860068 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.859985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shrnb\" (UniqueName: \"kubernetes.io/projected/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-kube-api-access-shrnb\") pod \"payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:44.860134 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.860073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmrws\" (UniqueName: \"kubernetes.io/projected/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-kube-api-access-dmrws\") pod \"payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:44.860134 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.860110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:44.861407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.861386 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7"] Sep 10 17:46:44.961575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.961513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmrws\" (UniqueName: \"kubernetes.io/projected/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-kube-api-access-dmrws\") pod \"payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:44.961575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.961547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:44.961739 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.961594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:44.961739 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.961664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shrnb\" (UniqueName: \"kubernetes.io/projected/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-kube-api-access-shrnb\") pod \"payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:44.962244 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.962223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:44.962280 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.962269 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:44.970682 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.970659 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shrnb\" (UniqueName: \"kubernetes.io/projected/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-kube-api-access-shrnb\") pod \"payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:44.970772 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.970683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmrws\" (UniqueName: \"kubernetes.io/projected/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-kube-api-access-dmrws\") pod \"payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:44.988977 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:44.988944 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:45.124953 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.124919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:45.157149 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.157120 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:45.398555 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.398526 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb"] Sep 10 17:46:45.399768 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:46:45.399745 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1680f4_6d1a_4dde_bcc9_71e844a83cc6.slice/crio-0e1024d05843237e9c5c320d8f46901bf34bdf1fafed4db21dd2f221ecf578da WatchSource:0}: Error finding container 0e1024d05843237e9c5c320d8f46901bf34bdf1fafed4db21dd2f221ecf578da: Status 404 returned error can't find the container with id 0e1024d05843237e9c5c320d8f46901bf34bdf1fafed4db21dd2f221ecf578da Sep 10 17:46:45.438092 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.438067 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7"] Sep 10 17:46:45.445633 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:46:45.445605 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e366ea_c7f6_4f39_9c4a_9a322e610a65.slice/crio-3c3eac5f2e3fcab13883eaa1ca7d56de11707d472859fbef1d4817aced16422a WatchSource:0}: Error finding container 3c3eac5f2e3fcab13883eaa1ca7d56de11707d472859fbef1d4817aced16422a: Status 404 returned error can't find the container with id 3c3eac5f2e3fcab13883eaa1ca7d56de11707d472859fbef1d4817aced16422a Sep 10 17:46:45.599651 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.599594 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" event={"ID":"f2e366ea-c7f6-4f39-9c4a-9a322e610a65","Type":"ContainerStarted","Data":"0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10"} Sep 10 17:46:45.599820 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.599682 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" event={"ID":"f2e366ea-c7f6-4f39-9c4a-9a322e610a65","Type":"ContainerStarted","Data":"3c3eac5f2e3fcab13883eaa1ca7d56de11707d472859fbef1d4817aced16422a"} Sep 10 17:46:45.599889 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.599837 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:45.601311 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.601289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" event={"ID":"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6","Type":"ContainerStarted","Data":"f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b"} Sep 10 17:46:45.601426 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.601326 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" event={"ID":"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6","Type":"ContainerStarted","Data":"0e1024d05843237e9c5c320d8f46901bf34bdf1fafed4db21dd2f221ecf578da"} Sep 10 17:46:45.601515 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.601456 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:46:45.617487 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.617441 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" podStartSLOduration=1.61742604 podStartE2EDuration="1.61742604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:45.616102062 +0000 UTC m=+1372.636029213" watchObservedRunningTime="2026-09-10 17:46:45.61742604 +0000 UTC m=+1372.637353192" Sep 10 17:46:45.632928 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:45.632889 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" podStartSLOduration=1.6328767100000001 podStartE2EDuration="1.63287671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:45.630315972 +0000 UTC m=+1372.650243122" watchObservedRunningTime="2026-09-10 17:46:45.63287671 +0000 UTC m=+1372.652803861" Sep 10 17:46:51.024026 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:51.023990 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:46:53.550216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:53.550186 2580 scope.go:117] "RemoveContainer" containerID="dc0319e1accb443788dc8db2de84d1b368b1a3525e6a1520e73f0852806b5515" Sep 10 17:46:56.616741 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:56.616714 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:46:56.617099 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:46:56.616776 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:47:03.826193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:03.826160 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:05.139498 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:05.139466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:05.909846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:05.909811 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:06.758996 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:06.758963 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:07.907246 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:07.907215 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:08.421692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:08.421666 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:08.784115 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:08.784073 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:09.144441 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:09.144362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:12.090963 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:12.090928 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:12.184928 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:12.184904 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:13.283934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.283900 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:13.362548 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.362513 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:13.499419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.499388 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:13.830628 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.830599 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:13.935581 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.935535 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:13.988434 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.988406 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc"] Sep 10 17:47:13.991912 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.991896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:13.995129 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.995108 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-912593-dockercfg-tx5nw\"" Sep 10 17:47:13.995485 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:13.995463 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-912593\"" Sep 10 17:47:14.008122 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.008092 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc"] Sep 10 17:47:14.109302 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.109215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4885833-0996-4489-ad54-af0c5e786567-plugins-config-volume\") pod \"payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.109511 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.109490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdpg\" (UniqueName: \"kubernetes.io/projected/d4885833-0996-4489-ad54-af0c5e786567-kube-api-access-cpdpg\") pod \"payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.210104 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.210077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdpg\" (UniqueName: \"kubernetes.io/projected/d4885833-0996-4489-ad54-af0c5e786567-kube-api-access-cpdpg\") pod \"payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.210235 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.210140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4885833-0996-4489-ad54-af0c5e786567-plugins-config-volume\") pod \"payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.210818 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.210800 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4885833-0996-4489-ad54-af0c5e786567-plugins-config-volume\") pod \"payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.218169 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.218150 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdpg\" (UniqueName: \"kubernetes.io/projected/d4885833-0996-4489-ad54-af0c5e786567-kube-api-access-cpdpg\") pod \"payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.302183 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.302160 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.576728 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.576701 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc"] Sep 10 17:47:14.578769 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:47:14.578742 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4885833_0996_4489_ad54_af0c5e786567.slice/crio-e7d022a9e28fea694303ed1a27042a801fb30e2f87d7f8e0ff5a2c01579105ab WatchSource:0}: Error finding container e7d022a9e28fea694303ed1a27042a801fb30e2f87d7f8e0ff5a2c01579105ab: Status 404 returned error can't find the container with id e7d022a9e28fea694303ed1a27042a801fb30e2f87d7f8e0ff5a2c01579105ab Sep 10 17:47:14.787759 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.787707 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" event={"ID":"d4885833-0996-4489-ad54-af0c5e786567","Type":"ContainerStarted","Data":"129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb"} Sep 10 17:47:14.787920 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.787821 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:14.787920 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.787848 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" event={"ID":"d4885833-0996-4489-ad54-af0c5e786567","Type":"ContainerStarted","Data":"e7d022a9e28fea694303ed1a27042a801fb30e2f87d7f8e0ff5a2c01579105ab"} Sep 10 17:47:14.808924 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:14.808879 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" podStartSLOduration=1.808865529 podStartE2EDuration="1.808865529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:14.805879821 +0000 UTC m=+1401.825806971" watchObservedRunningTime="2026-09-10 17:47:14.808865529 +0000 UTC m=+1401.828792721" Sep 10 17:47:25.795364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:25.795333 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:47:26.352453 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:26.352429 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:32.244271 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:32.244233 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:34.414582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:34.414550 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:34.836040 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:34.836008 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:35.633802 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:35.633768 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:37.122914 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:37.122886 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:40.438905 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:40.438869 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:53.570619 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:53.570551 2580 scope.go:117] "RemoveContainer" containerID="fe76c6f7f8015f657b5743bb78965faff46cd8de4191c68f96e6ce157dc4372b" Sep 10 17:47:53.579046 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:53.579028 2580 scope.go:117] "RemoveContainer" containerID="20c650acdde46049ed83dc0751bb7e3bf4e2ee40c7ddac2c0ae79a5a91d004d7" Sep 10 17:47:53.586942 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:53.586926 2580 scope.go:117] "RemoveContainer" containerID="b71f7cd289114d2ff2874dcc43420281f01f1b5a43b0cbe4c8e97e985b8a83cc" Sep 10 17:47:55.695440 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.695399 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:55.715977 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.715947 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7"] Sep 10 17:47:55.716205 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.716181 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" podUID="f2e366ea-c7f6-4f39-9c4a-9a322e610a65" containerName="payload-processing" containerID="cri-o://0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10" gracePeriod=30 Sep 10 17:47:55.725731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.725704 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb"] Sep 10 17:47:55.726052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.726003 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" podUID="cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" containerName="payload-pre-processing" containerID="cri-o://f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b" gracePeriod=30 Sep 10 17:47:55.769035 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.769006 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:55.869433 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.869406 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:55.943722 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:55.943689 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:56.001723 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.001701 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:47:56.004803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.004782 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:47:56.022997 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.022969 2580 generic.go:356] "Generic (PLEG): container finished" podID="f2e366ea-c7f6-4f39-9c4a-9a322e610a65" containerID="0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10" exitCode=0 Sep 10 17:47:56.023123 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.023018 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" event={"ID":"f2e366ea-c7f6-4f39-9c4a-9a322e610a65","Type":"ContainerDied","Data":"0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10"} Sep 10 17:47:56.023123 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.023028 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" Sep 10 17:47:56.023238 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.023121 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7" event={"ID":"f2e366ea-c7f6-4f39-9c4a-9a322e610a65","Type":"ContainerDied","Data":"3c3eac5f2e3fcab13883eaa1ca7d56de11707d472859fbef1d4817aced16422a"} Sep 10 17:47:56.023238 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.023154 2580 scope.go:117] "RemoveContainer" containerID="0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10" Sep 10 17:47:56.024967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.024914 2580 generic.go:356] "Generic (PLEG): container finished" podID="cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" containerID="f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b" exitCode=0 Sep 10 17:47:56.025040 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.024992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" event={"ID":"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6","Type":"ContainerDied","Data":"f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b"} Sep 10 17:47:56.025040 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.025029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" event={"ID":"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6","Type":"ContainerDied","Data":"0e1024d05843237e9c5c320d8f46901bf34bdf1fafed4db21dd2f221ecf578da"} Sep 10 17:47:56.025147 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.025099 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb" Sep 10 17:47:56.035956 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.035931 2580 scope.go:117] "RemoveContainer" containerID="0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10" Sep 10 17:47:56.036207 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.036184 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-plugins-config-volume\") pod \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " Sep 10 17:47:56.036307 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:47:56.036241 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10\": container with ID starting with 0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10 not found: ID does not exist" containerID="0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10" Sep 10 17:47:56.036307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.036254 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shrnb\" (UniqueName: \"kubernetes.io/projected/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-kube-api-access-shrnb\") pod \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\" (UID: \"cd1680f4-6d1a-4dde-bcc9-71e844a83cc6\") " Sep 10 17:47:56.036307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.036270 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10"} err="failed to get container status \"0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10\": rpc error: code = NotFound desc = could not find container \"0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10\": container with ID starting with 0c329b837762097267d74b85c2ae9082c12949ca732f09935888c6aa46512e10 not found: ID does not exist" Sep 10 17:47:56.036307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.036293 2580 scope.go:117] "RemoveContainer" containerID="f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b" Sep 10 17:47:56.036307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.036301 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmrws\" (UniqueName: \"kubernetes.io/projected/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-kube-api-access-dmrws\") pod \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " Sep 10 17:47:56.036553 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.036339 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-plugins-config-volume\") pod \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\" (UID: \"f2e366ea-c7f6-4f39-9c4a-9a322e610a65\") " Sep 10 17:47:56.037112 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.037083 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" (UID: "cd1680f4-6d1a-4dde-bcc9-71e844a83cc6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:47:56.037216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.037193 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2e366ea-c7f6-4f39-9c4a-9a322e610a65" (UID: "f2e366ea-c7f6-4f39-9c4a-9a322e610a65"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:47:56.038577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.038556 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-kube-api-access-dmrws" (OuterVolumeSpecName: "kube-api-access-dmrws") pod "f2e366ea-c7f6-4f39-9c4a-9a322e610a65" (UID: "f2e366ea-c7f6-4f39-9c4a-9a322e610a65"). InnerVolumeSpecName "kube-api-access-dmrws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:47:56.038942 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.038917 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-kube-api-access-shrnb" (OuterVolumeSpecName: "kube-api-access-shrnb") pod "cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" (UID: "cd1680f4-6d1a-4dde-bcc9-71e844a83cc6"). InnerVolumeSpecName "kube-api-access-shrnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:47:56.070721 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.070660 2580 scope.go:117] "RemoveContainer" containerID="f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b" Sep 10 17:47:56.073769 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:47:56.072326 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b\": container with ID starting with f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b not found: ID does not exist" containerID="f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b" Sep 10 17:47:56.073769 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.072380 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b"} err="failed to get container status \"f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b\": rpc error: code = NotFound desc = could not find container \"f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b\": container with ID starting with f165b485b9d85095586d06f05f65b14e0428dfa7de1e3993c0c487b45685b59b not found: ID does not exist" Sep 10 17:47:56.137497 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.137465 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmrws\" (UniqueName: \"kubernetes.io/projected/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-kube-api-access-dmrws\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:47:56.137497 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.137490 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e366ea-c7f6-4f39-9c4a-9a322e610a65-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:47:56.137497 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.137499 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:47:56.137747 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.137507 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shrnb\" (UniqueName: \"kubernetes.io/projected/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6-kube-api-access-shrnb\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:47:56.243097 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.243025 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:56.348238 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.348211 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb"] Sep 10 17:47:56.353614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.353590 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb"] Sep 10 17:47:56.362752 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.362733 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7"] Sep 10 17:47:56.366999 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:56.366977 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7"] Sep 10 17:47:57.431933 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:57.431901 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" path="/var/lib/kubelet/pods/cd1680f4-6d1a-4dde-bcc9-71e844a83cc6/volumes" Sep 10 17:47:57.432403 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:47:57.432226 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2e366ea-c7f6-4f39-9c4a-9a322e610a65" path="/var/lib/kubelet/pods/f2e366ea-c7f6-4f39-9c4a-9a322e610a65/volumes" Sep 10 17:48:01.931041 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:01.931006 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:01.999995 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:01.999952 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:02.314632 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:02.314604 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:02.824374 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:02.824344 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:18.205030 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.204996 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:18.234460 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.234432 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc"] Sep 10 17:48:18.234699 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.234675 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" podUID="d4885833-0996-4489-ad54-af0c5e786567" containerName="payload-processing" containerID="cri-o://129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb" gracePeriod=30 Sep 10 17:48:18.307675 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.307629 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:18.417108 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.417072 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:18.503692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.503666 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:48:18.515600 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.515576 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:18.594558 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.594520 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:18.623802 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.623779 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4885833-0996-4489-ad54-af0c5e786567-plugins-config-volume\") pod \"d4885833-0996-4489-ad54-af0c5e786567\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " Sep 10 17:48:18.623898 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.623886 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpdpg\" (UniqueName: \"kubernetes.io/projected/d4885833-0996-4489-ad54-af0c5e786567-kube-api-access-cpdpg\") pod \"d4885833-0996-4489-ad54-af0c5e786567\" (UID: \"d4885833-0996-4489-ad54-af0c5e786567\") " Sep 10 17:48:18.624120 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.624101 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4885833-0996-4489-ad54-af0c5e786567-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4885833-0996-4489-ad54-af0c5e786567" (UID: "d4885833-0996-4489-ad54-af0c5e786567"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:18.624185 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.624173 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4885833-0996-4489-ad54-af0c5e786567-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:18.626014 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.625995 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4885833-0996-4489-ad54-af0c5e786567-kube-api-access-cpdpg" (OuterVolumeSpecName: "kube-api-access-cpdpg") pod "d4885833-0996-4489-ad54-af0c5e786567" (UID: "d4885833-0996-4489-ad54-af0c5e786567"). InnerVolumeSpecName "kube-api-access-cpdpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:18.725217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.725187 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpdpg\" (UniqueName: \"kubernetes.io/projected/d4885833-0996-4489-ad54-af0c5e786567-kube-api-access-cpdpg\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:18.929485 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:18.929400 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:19.166802 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.166770 2580 generic.go:356] "Generic (PLEG): container finished" podID="d4885833-0996-4489-ad54-af0c5e786567" containerID="129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb" exitCode=0 Sep 10 17:48:19.166937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.166812 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" Sep 10 17:48:19.166937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.166838 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" event={"ID":"d4885833-0996-4489-ad54-af0c5e786567","Type":"ContainerDied","Data":"129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb"} Sep 10 17:48:19.166937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.166885 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc" event={"ID":"d4885833-0996-4489-ad54-af0c5e786567","Type":"ContainerDied","Data":"e7d022a9e28fea694303ed1a27042a801fb30e2f87d7f8e0ff5a2c01579105ab"} Sep 10 17:48:19.166937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.166908 2580 scope.go:117] "RemoveContainer" containerID="129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb" Sep 10 17:48:19.176378 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.176361 2580 scope.go:117] "RemoveContainer" containerID="129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb" Sep 10 17:48:19.176672 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:48:19.176633 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb\": container with ID starting with 129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb not found: ID does not exist" containerID="129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb" Sep 10 17:48:19.176768 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.176681 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb"} err="failed to get container status \"129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb\": rpc error: code = NotFound desc = could not find container \"129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb\": container with ID starting with 129c2bd23f980d821029168fafa53d0a3fe851a7e07ba4b81f49ca3171c6defb not found: ID does not exist" Sep 10 17:48:19.194741 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.194692 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc"] Sep 10 17:48:19.204841 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.204817 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc"] Sep 10 17:48:19.432008 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:19.431988 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4885833-0996-4489-ad54-af0c5e786567" path="/var/lib/kubelet/pods/d4885833-0996-4489-ad54-af0c5e786567/volumes" Sep 10 17:48:24.822000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:24.821968 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:24.925210 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:24.925177 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:25.126478 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.126391 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:25.452077 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452053 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9"] Sep 10 17:48:25.452426 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452415 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2e366ea-c7f6-4f39-9c4a-9a322e610a65" containerName="payload-processing" Sep 10 17:48:25.452472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452428 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2e366ea-c7f6-4f39-9c4a-9a322e610a65" containerName="payload-processing" Sep 10 17:48:25.452472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452441 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4885833-0996-4489-ad54-af0c5e786567" containerName="payload-processing" Sep 10 17:48:25.452472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452446 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4885833-0996-4489-ad54-af0c5e786567" containerName="payload-processing" Sep 10 17:48:25.452472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452459 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" containerName="payload-pre-processing" Sep 10 17:48:25.452472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452466 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" containerName="payload-pre-processing" Sep 10 17:48:25.452617 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452531 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd1680f4-6d1a-4dde-bcc9-71e844a83cc6" containerName="payload-pre-processing" Sep 10 17:48:25.452617 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452540 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2e366ea-c7f6-4f39-9c4a-9a322e610a65" containerName="payload-processing" Sep 10 17:48:25.452617 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.452546 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4885833-0996-4489-ad54-af0c5e786567" containerName="payload-processing" Sep 10 17:48:25.455555 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.455541 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" Sep 10 17:48:25.457704 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.457682 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 17:48:25.457828 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.457752 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-77v6x\"" Sep 10 17:48:25.463963 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.463941 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9"] Sep 10 17:48:25.561054 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.561022 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:25.578039 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.578014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb02feb-0418-46ed-ad68-9d35b659aebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9\" (UID: \"6bb02feb-0418-46ed-ad68-9d35b659aebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" Sep 10 17:48:25.679043 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.679014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb02feb-0418-46ed-ad68-9d35b659aebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9\" (UID: \"6bb02feb-0418-46ed-ad68-9d35b659aebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" Sep 10 17:48:25.679612 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.679593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb02feb-0418-46ed-ad68-9d35b659aebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9\" (UID: \"6bb02feb-0418-46ed-ad68-9d35b659aebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" Sep 10 17:48:25.767032 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:25.766969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" Sep 10 17:48:26.038863 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:26.038832 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9"] Sep 10 17:48:26.041594 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:48:26.041564 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb02feb_0418_46ed_ad68_9d35b659aebb.slice/crio-553c1039c46ca6b4f6d9d5f283634f5dc9f3b4a71cd88c6c7ad9a846cb11c234 WatchSource:0}: Error finding container 553c1039c46ca6b4f6d9d5f283634f5dc9f3b4a71cd88c6c7ad9a846cb11c234: Status 404 returned error can't find the container with id 553c1039c46ca6b4f6d9d5f283634f5dc9f3b4a71cd88c6c7ad9a846cb11c234 Sep 10 17:48:26.209536 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:26.209483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" event={"ID":"6bb02feb-0418-46ed-ad68-9d35b659aebb","Type":"ContainerStarted","Data":"553c1039c46ca6b4f6d9d5f283634f5dc9f3b4a71cd88c6c7ad9a846cb11c234"} Sep 10 17:48:27.217970 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:27.217942 2580 generic.go:356] "Generic (PLEG): container finished" podID="6bb02feb-0418-46ed-ad68-9d35b659aebb" containerID="1ae199fc89591e1c77290f576ecd9161e8d758fc691ff97d70ba22587b53a6ee" exitCode=0 Sep 10 17:48:27.218344 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:27.218028 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" event={"ID":"6bb02feb-0418-46ed-ad68-9d35b659aebb","Type":"ContainerDied","Data":"1ae199fc89591e1c77290f576ecd9161e8d758fc691ff97d70ba22587b53a6ee"} Sep 10 17:48:28.212235 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:28.212190 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:28.362328 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:28.362301 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" Sep 10 17:48:28.501673 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:28.501592 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb02feb-0418-46ed-ad68-9d35b659aebb-maas-api-service-ca\") pod \"6bb02feb-0418-46ed-ad68-9d35b659aebb\" (UID: \"6bb02feb-0418-46ed-ad68-9d35b659aebb\") " Sep 10 17:48:28.501927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:28.501906 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb02feb-0418-46ed-ad68-9d35b659aebb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6bb02feb-0418-46ed-ad68-9d35b659aebb" (UID: "6bb02feb-0418-46ed-ad68-9d35b659aebb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:28.602332 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:28.602309 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb02feb-0418-46ed-ad68-9d35b659aebb-maas-api-service-ca\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:29.206517 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.206486 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:29.230156 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.230135 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" Sep 10 17:48:29.230291 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.230168 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9" event={"ID":"6bb02feb-0418-46ed-ad68-9d35b659aebb","Type":"ContainerDied","Data":"553c1039c46ca6b4f6d9d5f283634f5dc9f3b4a71cd88c6c7ad9a846cb11c234"} Sep 10 17:48:29.230291 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.230212 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="553c1039c46ca6b4f6d9d5f283634f5dc9f3b4a71cd88c6c7ad9a846cb11c234" Sep 10 17:48:29.671502 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.671421 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:29.972499 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.972470 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn"] Sep 10 17:48:29.972891 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.972876 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb02feb-0418-46ed-ad68-9d35b659aebb" containerName="revoke-keys" Sep 10 17:48:29.972945 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.972893 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb02feb-0418-46ed-ad68-9d35b659aebb" containerName="revoke-keys" Sep 10 17:48:29.972979 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.972957 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb02feb-0418-46ed-ad68-9d35b659aebb" containerName="revoke-keys" Sep 10 17:48:29.975771 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.975754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:29.977819 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.977801 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-dc47cd-openshift-default-dockercfg-d4wx8\"" Sep 10 17:48:29.988885 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:29.988867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn"] Sep 10 17:48:30.007477 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.007443 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.115842 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.115808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-podinfo\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.115856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-token\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.115883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-envoy\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.115905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bsqk\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-kube-api-access-9bsqk\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.115933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-socket\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116031 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.116027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istiod-ca-cert\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116262 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.116105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-credential-socket\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116262 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.116131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-data\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.116262 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.116157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-certs\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.161276 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.161249 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.217718 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-credential-socket\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.217718 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-data\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.217967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-certs\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.217967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-podinfo\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.217967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-token\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.217967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-envoy\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.217967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bsqk\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-kube-api-access-9bsqk\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.217967 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.217922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-socket\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.218285 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.218134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-credential-socket\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.218361 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.218331 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-certs\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.218440 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.218419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istiod-ca-cert\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.218499 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.218453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-data\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.218695 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.218671 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-socket\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.219209 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.219178 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istiod-ca-cert\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.220670 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.220624 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-podinfo\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.220774 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.220757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-envoy\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.225934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.225883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-token\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.225934 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.225891 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bsqk\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-kube-api-access-9bsqk\") pod \"e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.286017 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.285996 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:30.564990 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.564954 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn"] Sep 10 17:48:30.565883 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:48:30.565856 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0c8afa_3fcc_4deb_a137_a19b41f464a6.slice/crio-fb083f6397ed35a4e81f182e5263d50f3220ee15d0160ab58e405b37858301f6 WatchSource:0}: Error finding container fb083f6397ed35a4e81f182e5263d50f3220ee15d0160ab58e405b37858301f6: Status 404 returned error can't find the container with id fb083f6397ed35a4e81f182e5263d50f3220ee15d0160ab58e405b37858301f6 Sep 10 17:48:30.573672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.568600 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:48:30.573672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.568779 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:48:30.573672 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:30.568870 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:48:31.242987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:31.242947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" event={"ID":"ca0c8afa-3fcc-4deb-a137-a19b41f464a6","Type":"ContainerStarted","Data":"9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22"} Sep 10 17:48:31.243325 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:31.243042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" event={"ID":"ca0c8afa-3fcc-4deb-a137-a19b41f464a6","Type":"ContainerStarted","Data":"fb083f6397ed35a4e81f182e5263d50f3220ee15d0160ab58e405b37858301f6"} Sep 10 17:48:31.265381 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:31.265333 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podStartSLOduration=2.265317466 podStartE2EDuration="2.265317466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:31.26245301 +0000 UTC m=+1478.282380161" watchObservedRunningTime="2026-09-10 17:48:31.265317466 +0000 UTC m=+1478.285244617" Sep 10 17:48:31.286578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:31.286555 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:31.291303 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:31.291282 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:32.248447 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:32.248419 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:32.249328 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:32.249310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:33.211600 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:33.211569 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:33.303234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:33.303209 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.512333 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:34.512305 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.612047 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:34.612016 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.053996 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.053962 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.153582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.153550 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.205099 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.205071 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q"] Sep 10 17:48:35.208849 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.208828 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.211442 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.211417 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-dc47cd\"" Sep 10 17:48:35.211442 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.211439 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-dc47cd-dockercfg-9fsfz\"" Sep 10 17:48:35.221692 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.221672 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q"] Sep 10 17:48:35.243330 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.243306 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl"] Sep 10 17:48:35.246783 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.246766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.253225 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.253203 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.260275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.260253 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl"] Sep 10 17:48:35.362340 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.362260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvfmc\" (UniqueName: \"kubernetes.io/projected/c32abb9f-648f-46a9-88b9-ea72862657ba-kube-api-access-bvfmc\") pod \"payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.362340 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.362322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c32abb9f-648f-46a9-88b9-ea72862657ba-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.362572 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.362395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.362572 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.362444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz77m\" (UniqueName: \"kubernetes.io/projected/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-kube-api-access-pz77m\") pod \"payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.463793 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.463764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvfmc\" (UniqueName: \"kubernetes.io/projected/c32abb9f-648f-46a9-88b9-ea72862657ba-kube-api-access-bvfmc\") pod \"payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.463909 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.463819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c32abb9f-648f-46a9-88b9-ea72862657ba-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.463909 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.463840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.463909 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.463863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz77m\" (UniqueName: \"kubernetes.io/projected/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-kube-api-access-pz77m\") pod \"payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.464441 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.464422 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c32abb9f-648f-46a9-88b9-ea72862657ba-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.464592 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.464576 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.472173 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.472145 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvfmc\" (UniqueName: \"kubernetes.io/projected/c32abb9f-648f-46a9-88b9-ea72862657ba-kube-api-access-bvfmc\") pod \"payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.472301 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.472201 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz77m\" (UniqueName: \"kubernetes.io/projected/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-kube-api-access-pz77m\") pod \"payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.520796 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.520772 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:35.557788 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.557759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:35.802676 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.796844 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q"] Sep 10 17:48:35.847149 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:48:35.847125 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32abb9f_648f_46a9_88b9_ea72862657ba.slice/crio-59ca0762c058eff4c1a6d138153f4cb18fad486a56fef062e53e7ffca645cb02 WatchSource:0}: Error finding container 59ca0762c058eff4c1a6d138153f4cb18fad486a56fef062e53e7ffca645cb02: Status 404 returned error can't find the container with id 59ca0762c058eff4c1a6d138153f4cb18fad486a56fef062e53e7ffca645cb02 Sep 10 17:48:35.847230 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:35.847146 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl"] Sep 10 17:48:36.014147 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.014104 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm"] Sep 10 17:48:36.016676 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.016654 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c990a5-29817705-4s7gm"] Sep 10 17:48:36.022550 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.022528 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:36.122995 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.122958 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:36.199234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.199060 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9"] Sep 10 17:48:36.200912 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.200888 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:36.201999 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.201978 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c990a5-z2ss9"] Sep 10 17:48:36.266067 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.266044 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:36.278187 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.278152 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" event={"ID":"c32abb9f-648f-46a9-88b9-ea72862657ba","Type":"ContainerStarted","Data":"0b75e653c3307c73f805d7ba5d2237176b8d2c129fe166d0b00219c00de107db"} Sep 10 17:48:36.278344 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.278217 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" event={"ID":"c32abb9f-648f-46a9-88b9-ea72862657ba","Type":"ContainerStarted","Data":"59ca0762c058eff4c1a6d138153f4cb18fad486a56fef062e53e7ffca645cb02"} Sep 10 17:48:36.278429 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.278411 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:36.280926 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.280893 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" event={"ID":"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a","Type":"ContainerStarted","Data":"4eb4163cb7d554de1295f7229bb78bfb59b7b5bb5681d47527e4f4cd3609d7fe"} Sep 10 17:48:36.281064 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.280944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" event={"ID":"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a","Type":"ContainerStarted","Data":"52519de969eaf500ef0749164d9cc1072386ce577cd65520f5276c6f5fa8195d"} Sep 10 17:48:36.281132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.281062 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:36.297246 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.297194 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" podStartSLOduration=1.297163664 podStartE2EDuration="1.297163664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:36.295901476 +0000 UTC m=+1483.315828631" watchObservedRunningTime="2026-09-10 17:48:36.297163664 +0000 UTC m=+1483.317090816" Sep 10 17:48:36.316758 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.316692 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" podStartSLOduration=1.316671839 podStartE2EDuration="1.316671839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:36.312976153 +0000 UTC m=+1483.332903306" watchObservedRunningTime="2026-09-10 17:48:36.316671839 +0000 UTC m=+1483.336598989" Sep 10 17:48:36.582060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:36.582025 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:37.433792 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:37.433763 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb02feb-0418-46ed-ad68-9d35b659aebb" path="/var/lib/kubelet/pods/6bb02feb-0418-46ed-ad68-9d35b659aebb/volumes" Sep 10 17:48:37.434165 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:37.434151 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0b6768-9b74-42e2-81a2-f06980e21b6f" path="/var/lib/kubelet/pods/8b0b6768-9b74-42e2-81a2-f06980e21b6f/volumes" Sep 10 17:48:42.718001 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:42.717962 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:42.782891 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:42.782857 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:42.974838 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:42.974752 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k"] Sep 10 17:48:42.975027 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:42.974992 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" containerID="cri-o://6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956" gracePeriod=30 Sep 10 17:48:43.025098 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:43.025068 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:43.451240 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:43.450304 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:46.693052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:46.693014 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:46.751955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:46.751890 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:47.289035 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:47.289006 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:48:47.289282 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:47.289263 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:48:48.014948 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.014919 2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Sep 10 17:48:48.015279 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.014984 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Sep 10 17:48:48.233188 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.233165 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:48:48.289834 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.289766 2580 patch_prober.go:28] interesting pod/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 10 17:48:48.289951 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.289827 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 10 17:48:48.303803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.303779 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-credential-socket\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.303917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.303856 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-socket\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.303917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.303896 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-data\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.304025 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.303925 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-certs\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.304025 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.303959 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-token\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.304025 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.303991 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-envoy\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.304177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304035 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-podinfo\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.304177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304052 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:48.304177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304075 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istiod-ca-cert\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.304177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304101 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:48.304177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304109 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46zdk\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-kube-api-access-46zdk\") pod \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\" (UID: \"bfd3b0c1-a168-4bd9-ad64-46d431f75a94\") " Sep 10 17:48:48.304177 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304135 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:48.304473 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304200 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:48.304525 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304492 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:48.304572 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304556 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.304628 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304574 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.304628 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304585 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.304628 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304594 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.304628 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.304607 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.306424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.306403 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:48:48.306424 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.306402 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:48.306589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.306567 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:48.306714 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.306627 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-kube-api-access-46zdk" (OuterVolumeSpecName: "kube-api-access-46zdk") pod "bfd3b0c1-a168-4bd9-ad64-46d431f75a94" (UID: "bfd3b0c1-a168-4bd9-ad64-46d431f75a94"). InnerVolumeSpecName "kube-api-access-46zdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:48.364143 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.364116 2580 generic.go:356] "Generic (PLEG): container finished" podID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerID="6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956" exitCode=0 Sep 10 17:48:48.364250 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.364159 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" Sep 10 17:48:48.364250 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.364180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" event={"ID":"bfd3b0c1-a168-4bd9-ad64-46d431f75a94","Type":"ContainerDied","Data":"6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956"} Sep 10 17:48:48.364250 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.364239 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k" event={"ID":"bfd3b0c1-a168-4bd9-ad64-46d431f75a94","Type":"ContainerDied","Data":"9ec279312fda91bab2ee451d4304e974230e9eb52973f5c92fc64f07932fe5c5"} Sep 10 17:48:48.364370 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.364269 2580 scope.go:117] "RemoveContainer" containerID="6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956" Sep 10 17:48:48.374691 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.374674 2580 scope.go:117] "RemoveContainer" containerID="9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785" Sep 10 17:48:48.384780 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.384759 2580 scope.go:117] "RemoveContainer" containerID="6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956" Sep 10 17:48:48.385336 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:48:48.385316 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956\": container with ID starting with 6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956 not found: ID does not exist" containerID="6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956" Sep 10 17:48:48.385410 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.385343 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956"} err="failed to get container status \"6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956\": rpc error: code = NotFound desc = could not find container \"6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956\": container with ID starting with 6202475e2b3dd3b83da963d91df01e3d61bc3cedc4c21e18b94a8031b342c956 not found: ID does not exist" Sep 10 17:48:48.385410 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.385360 2580 scope.go:117] "RemoveContainer" containerID="9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785" Sep 10 17:48:48.385743 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:48:48.385616 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785\": container with ID starting with 9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785 not found: ID does not exist" containerID="9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785" Sep 10 17:48:48.385878 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.385796 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785"} err="failed to get container status \"9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785\": rpc error: code = NotFound desc = could not find container \"9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785\": container with ID starting with 9f5d5f47d9d87f9281b70efd4f777d824052338da568825a45a04342383ce785 not found: ID does not exist" Sep 10 17:48:48.389213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.389191 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k"] Sep 10 17:48:48.393287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.393263 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k"] Sep 10 17:48:48.405730 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.405708 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.405730 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.405726 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.405844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.405734 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:48.405844 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:48.405743 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46zdk\" (UniqueName: \"kubernetes.io/projected/bfd3b0c1-a168-4bd9-ad64-46d431f75a94-kube-api-access-46zdk\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:49.431516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:49.431486 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" path="/var/lib/kubelet/pods/bfd3b0c1-a168-4bd9-ad64-46d431f75a94/volumes" Sep 10 17:48:50.379825 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:50.379795 2580 generic.go:356] "Generic (PLEG): container finished" podID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerID="9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22" exitCode=0 Sep 10 17:48:50.380019 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:50.379868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" event={"ID":"ca0c8afa-3fcc-4deb-a137-a19b41f464a6","Type":"ContainerDied","Data":"9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22"} Sep 10 17:48:50.380250 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:50.380235 2580 scope.go:117] "RemoveContainer" containerID="9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22" Sep 10 17:48:50.381235 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:50.381210 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:48:50.381310 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:50.381282 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:48:50.381355 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:50.381318 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Sep 10 17:48:51.389437 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:51.389397 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" event={"ID":"ca0c8afa-3fcc-4deb-a137-a19b41f464a6","Type":"ContainerStarted","Data":"d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a"} Sep 10 17:48:52.286426 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:52.286388 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:52.286712 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:52.286688 2580 patch_prober.go:28] interesting pod/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Sep 10 17:48:52.286775 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:52.286747 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Sep 10 17:48:53.286435 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.286397 2580 patch_prober.go:28] interesting pod/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Sep 10 17:48:53.286855 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.286461 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Sep 10 17:48:53.810365 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.810328 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:53.823341 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.823303 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t"] Sep 10 17:48:53.823509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.823359 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-762738-29817705-2dp8t"] Sep 10 17:48:53.865156 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.865117 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph"] Sep 10 17:48:53.865701 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.865626 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" podUID="7f06d399-7dfe-430b-818b-c5fc1f7f3180" containerName="payload-pre-processing" containerID="cri-o://7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3" gracePeriod=30 Sep 10 17:48:53.894826 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.894793 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:53.959610 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:53.959574 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:54.038663 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.038114 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:54.099445 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.099418 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:54.164401 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.164378 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:48:54.261948 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.261915 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lp5q\" (UniqueName: \"kubernetes.io/projected/7f06d399-7dfe-430b-818b-c5fc1f7f3180-kube-api-access-8lp5q\") pod \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " Sep 10 17:48:54.261948 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.261951 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f06d399-7dfe-430b-818b-c5fc1f7f3180-plugins-config-volume\") pod \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\" (UID: \"7f06d399-7dfe-430b-818b-c5fc1f7f3180\") " Sep 10 17:48:54.262384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.262349 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f06d399-7dfe-430b-818b-c5fc1f7f3180-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f06d399-7dfe-430b-818b-c5fc1f7f3180" (UID: "7f06d399-7dfe-430b-818b-c5fc1f7f3180"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:54.264070 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.264041 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f06d399-7dfe-430b-818b-c5fc1f7f3180-kube-api-access-8lp5q" (OuterVolumeSpecName: "kube-api-access-8lp5q") pod "7f06d399-7dfe-430b-818b-c5fc1f7f3180" (UID: "7f06d399-7dfe-430b-818b-c5fc1f7f3180"). InnerVolumeSpecName "kube-api-access-8lp5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:54.286516 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.286486 2580 patch_prober.go:28] interesting pod/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Sep 10 17:48:54.286851 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.286534 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Sep 10 17:48:54.363729 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.363699 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lp5q\" (UniqueName: \"kubernetes.io/projected/7f06d399-7dfe-430b-818b-c5fc1f7f3180-kube-api-access-8lp5q\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:54.363729 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.363723 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f06d399-7dfe-430b-818b-c5fc1f7f3180-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:48:54.373275 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.373250 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:54.408437 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.408373 2580 generic.go:356] "Generic (PLEG): container finished" podID="7f06d399-7dfe-430b-818b-c5fc1f7f3180" containerID="7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3" exitCode=0 Sep 10 17:48:54.408437 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.408418 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" Sep 10 17:48:54.408567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.408462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" event={"ID":"7f06d399-7dfe-430b-818b-c5fc1f7f3180","Type":"ContainerDied","Data":"7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3"} Sep 10 17:48:54.408567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.408512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph" event={"ID":"7f06d399-7dfe-430b-818b-c5fc1f7f3180","Type":"ContainerDied","Data":"edeb8e15bf61032c4824984315eee58312f574b8b57187d777082401098ae379"} Sep 10 17:48:54.408567 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.408539 2580 scope.go:117] "RemoveContainer" containerID="7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3" Sep 10 17:48:54.418589 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.418573 2580 scope.go:117] "RemoveContainer" containerID="7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3" Sep 10 17:48:54.418910 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:48:54.418889 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3\": container with ID starting with 7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3 not found: ID does not exist" containerID="7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3" Sep 10 17:48:54.418984 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.418923 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3"} err="failed to get container status \"7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3\": rpc error: code = NotFound desc = could not find container \"7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3\": container with ID starting with 7787b48cd67b524689265a60fa45f928d7394bf30aa9108ea991126af23bc8d3 not found: ID does not exist" Sep 10 17:48:54.435488 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.435454 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph"] Sep 10 17:48:54.453469 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:54.453442 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph"] Sep 10 17:48:55.287284 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:55.287251 2580 patch_prober.go:28] interesting pod/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Sep 10 17:48:55.287773 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:55.287317 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Sep 10 17:48:55.435601 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:55.435562 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f06d399-7dfe-430b-818b-c5fc1f7f3180" path="/var/lib/kubelet/pods/7f06d399-7dfe-430b-818b-c5fc1f7f3180/volumes" Sep 10 17:48:55.436019 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:55.435993 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e" path="/var/lib/kubelet/pods/c7d2e596-c8fd-4e83-bcc1-3b5d61f7a71e/volumes" Sep 10 17:48:55.714355 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:55.714327 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:56.287054 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:56.287021 2580 patch_prober.go:28] interesting pod/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Sep 10 17:48:56.287234 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:56.287070 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Sep 10 17:48:57.289910 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:57.289884 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:57.290349 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:57.290211 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:57.290943 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:57.290923 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:48:58.185433 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:58.185404 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:58.850740 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:58.850701 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:59.162727 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:59.162632 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:59.262253 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:48:59.262227 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:00.431392 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:00.431358 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:00.507977 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:00.507943 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:00.704128 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:00.704094 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:01.444255 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:01.444217 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:02.799277 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:02.799245 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:02.895361 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:02.895333 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:03.944890 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:03.944858 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:04.046686 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:04.046652 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:04.298015 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:04.297983 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:04.429935 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:04.429882 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:04.532803 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:04.532758 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:27.689205 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:27.689118 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:32.731419 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:32.731383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2f4pf_3a240dad-cbbd-4e69-a10a-a56bf3221468/payload-processing/0.log" Sep 10 17:49:43.264774 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:49:43.264739 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:05.656936 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:05.656909 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl_c32abb9f-648f-46a9-88b9-ea72862657ba/payload-processing/0.log" Sep 10 17:50:05.793502 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:05.793472 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2f4pf_3a240dad-cbbd-4e69-a10a-a56bf3221468/payload-processing/0.log" Sep 10 17:50:06.200711 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:06.200685 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:06.518481 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:06.518404 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:06.749129 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:06.749099 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:10.027022 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:10.026988 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:10.128340 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:10.128311 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.227203 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.227156 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.299404 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.299361 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.473940 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.473905 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.739864 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.739833 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.839495 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.839471 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.940570 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.940541 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7"] Sep 10 17:50:11.940952 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.940940 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" Sep 10 17:50:11.941002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.940954 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" Sep 10 17:50:11.941002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.940964 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" Sep 10 17:50:11.941002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.940969 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" Sep 10 17:50:11.941002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.940975 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f06d399-7dfe-430b-818b-c5fc1f7f3180" containerName="payload-pre-processing" Sep 10 17:50:11.941002 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.940981 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f06d399-7dfe-430b-818b-c5fc1f7f3180" containerName="payload-pre-processing" Sep 10 17:50:11.941173 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.941038 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" Sep 10 17:50:11.941173 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.941047 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f06d399-7dfe-430b-818b-c5fc1f7f3180" containerName="payload-pre-processing" Sep 10 17:50:11.941173 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.941053 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd3b0c1-a168-4bd9-ad64-46d431f75a94" containerName="istio-proxy" Sep 10 17:50:11.945307 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.945293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:11.947801 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.947783 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-8e4477\"" Sep 10 17:50:11.947920 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.947786 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-8e4477-dockercfg-8nh5g\"" Sep 10 17:50:11.955135 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:11.955111 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7"] Sep 10 17:50:12.094954 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.094882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97rj2\" (UniqueName: \"kubernetes.io/projected/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-kube-api-access-97rj2\") pod \"payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.095095 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.094997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.196085 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.196059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97rj2\" (UniqueName: \"kubernetes.io/projected/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-kube-api-access-97rj2\") pod \"payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.196201 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.196124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.196765 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.196749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.204660 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.204626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97rj2\" (UniqueName: \"kubernetes.io/projected/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-kube-api-access-97rj2\") pod \"payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.256432 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.256411 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.530575 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.530545 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7"] Sep 10 17:50:12.535392 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:50:12.535367 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cb9969_3a9b_49a4_9707_dfc6207a7fc3.slice/crio-c43895ec79e9e8f2dd04c67c5c0353b08de89a8f14368c76b7404136b4eb556d WatchSource:0}: Error finding container c43895ec79e9e8f2dd04c67c5c0353b08de89a8f14368c76b7404136b4eb556d: Status 404 returned error can't find the container with id c43895ec79e9e8f2dd04c67c5c0353b08de89a8f14368c76b7404136b4eb556d Sep 10 17:50:12.847149 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.847066 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" event={"ID":"44cb9969-3a9b-49a4-9707-dfc6207a7fc3","Type":"ContainerStarted","Data":"bac5edc2a1dfbb1829675e5029887281e6abd16688e6b198a89cdd3b68d1d3c0"} Sep 10 17:50:12.847149 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.847126 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" event={"ID":"44cb9969-3a9b-49a4-9707-dfc6207a7fc3","Type":"ContainerStarted","Data":"c43895ec79e9e8f2dd04c67c5c0353b08de89a8f14368c76b7404136b4eb556d"} Sep 10 17:50:12.847327 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.847155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:12.864425 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:12.864375 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" podStartSLOduration=1.8643602910000001 podStartE2EDuration="1.864360291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:12.861975963 +0000 UTC m=+1579.881903127" watchObservedRunningTime="2026-09-10 17:50:12.864360291 +0000 UTC m=+1579.884287503" Sep 10 17:50:23.856824 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:23.856786 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:35.108391 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:35.108356 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:41.744340 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:41.744299 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:41.781978 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:41.781949 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7"] Sep 10 17:50:41.782201 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:41.782173 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" podUID="44cb9969-3a9b-49a4-9707-dfc6207a7fc3" containerName="payload-pre-processing" containerID="cri-o://bac5edc2a1dfbb1829675e5029887281e6abd16688e6b198a89cdd3b68d1d3c0" gracePeriod=30 Sep 10 17:50:41.845049 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:41.845010 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:41.944186 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:41.944142 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:42.015827 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.015802 2580 generic.go:356] "Generic (PLEG): container finished" podID="44cb9969-3a9b-49a4-9707-dfc6207a7fc3" containerID="bac5edc2a1dfbb1829675e5029887281e6abd16688e6b198a89cdd3b68d1d3c0" exitCode=0 Sep 10 17:50:42.015937 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.015865 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" event={"ID":"44cb9969-3a9b-49a4-9707-dfc6207a7fc3","Type":"ContainerDied","Data":"bac5edc2a1dfbb1829675e5029887281e6abd16688e6b198a89cdd3b68d1d3c0"} Sep 10 17:50:42.037871 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.037835 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:42.049510 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.046726 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:42.232865 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.232835 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97rj2\" (UniqueName: \"kubernetes.io/projected/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-kube-api-access-97rj2\") pod \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " Sep 10 17:50:42.233023 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.232903 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-plugins-config-volume\") pod \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\" (UID: \"44cb9969-3a9b-49a4-9707-dfc6207a7fc3\") " Sep 10 17:50:42.233267 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.233238 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44cb9969-3a9b-49a4-9707-dfc6207a7fc3" (UID: "44cb9969-3a9b-49a4-9707-dfc6207a7fc3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:50:42.235091 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.235075 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-kube-api-access-97rj2" (OuterVolumeSpecName: "kube-api-access-97rj2") pod "44cb9969-3a9b-49a4-9707-dfc6207a7fc3" (UID: "44cb9969-3a9b-49a4-9707-dfc6207a7fc3"). InnerVolumeSpecName "kube-api-access-97rj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:50:42.332082 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.332018 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:42.334024 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.334007 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:50:42.334110 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:42.334026 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97rj2\" (UniqueName: \"kubernetes.io/projected/44cb9969-3a9b-49a4-9707-dfc6207a7fc3-kube-api-access-97rj2\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:50:43.023821 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:43.023795 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" Sep 10 17:50:43.024256 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:43.023798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7" event={"ID":"44cb9969-3a9b-49a4-9707-dfc6207a7fc3","Type":"ContainerDied","Data":"c43895ec79e9e8f2dd04c67c5c0353b08de89a8f14368c76b7404136b4eb556d"} Sep 10 17:50:43.024256 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:43.023954 2580 scope.go:117] "RemoveContainer" containerID="bac5edc2a1dfbb1829675e5029887281e6abd16688e6b198a89cdd3b68d1d3c0" Sep 10 17:50:43.045488 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:43.045462 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7"] Sep 10 17:50:43.053205 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:43.053185 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7"] Sep 10 17:50:43.431547 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:43.431493 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44cb9969-3a9b-49a4-9707-dfc6207a7fc3" path="/var/lib/kubelet/pods/44cb9969-3a9b-49a4-9707-dfc6207a7fc3/volumes" Sep 10 17:50:48.550931 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:48.550858 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:48.650690 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:48.650622 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:48.806395 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:48.806286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:52.524350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:50:52.524317 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:07.909312 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:07.909241 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:07.930878 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:07.930851 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl"] Sep 10 17:51:07.931066 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:07.931043 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" podUID="c32abb9f-648f-46a9-88b9-ea72862657ba" containerName="payload-processing" containerID="cri-o://0b75e653c3307c73f805d7ba5d2237176b8d2c129fe166d0b00219c00de107db" gracePeriod=30 Sep 10 17:51:07.938318 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:07.938293 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q"] Sep 10 17:51:07.938528 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:07.938484 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" podUID="3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" containerName="payload-pre-processing" containerID="cri-o://4eb4163cb7d554de1295f7229bb78bfb59b7b5bb5681d47527e4f4cd3609d7fe" gracePeriod=30 Sep 10 17:51:08.009061 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.009033 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:08.096476 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.096437 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:08.165059 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.164959 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:08.203732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.200257 2580 generic.go:356] "Generic (PLEG): container finished" podID="c32abb9f-648f-46a9-88b9-ea72862657ba" containerID="0b75e653c3307c73f805d7ba5d2237176b8d2c129fe166d0b00219c00de107db" exitCode=0 Sep 10 17:51:08.203732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.200342 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" event={"ID":"c32abb9f-648f-46a9-88b9-ea72862657ba","Type":"ContainerDied","Data":"0b75e653c3307c73f805d7ba5d2237176b8d2c129fe166d0b00219c00de107db"} Sep 10 17:51:08.203732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.203171 2580 generic.go:356] "Generic (PLEG): container finished" podID="3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" containerID="4eb4163cb7d554de1295f7229bb78bfb59b7b5bb5681d47527e4f4cd3609d7fe" exitCode=0 Sep 10 17:51:08.203732 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.203280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" event={"ID":"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a","Type":"ContainerDied","Data":"4eb4163cb7d554de1295f7229bb78bfb59b7b5bb5681d47527e4f4cd3609d7fe"} Sep 10 17:51:08.246856 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.246829 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:51:08.249793 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.249770 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:51:08.344962 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.344930 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz77m\" (UniqueName: \"kubernetes.io/projected/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-kube-api-access-pz77m\") pod \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " Sep 10 17:51:08.345112 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.345051 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-plugins-config-volume\") pod \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\" (UID: \"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a\") " Sep 10 17:51:08.345112 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.345086 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvfmc\" (UniqueName: \"kubernetes.io/projected/c32abb9f-648f-46a9-88b9-ea72862657ba-kube-api-access-bvfmc\") pod \"c32abb9f-648f-46a9-88b9-ea72862657ba\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " Sep 10 17:51:08.345229 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.345128 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c32abb9f-648f-46a9-88b9-ea72862657ba-plugins-config-volume\") pod \"c32abb9f-648f-46a9-88b9-ea72862657ba\" (UID: \"c32abb9f-648f-46a9-88b9-ea72862657ba\") " Sep 10 17:51:08.345477 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.345445 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" (UID: "3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:51:08.345601 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.345521 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c32abb9f-648f-46a9-88b9-ea72862657ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c32abb9f-648f-46a9-88b9-ea72862657ba" (UID: "c32abb9f-648f-46a9-88b9-ea72862657ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:51:08.347220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.347194 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c32abb9f-648f-46a9-88b9-ea72862657ba-kube-api-access-bvfmc" (OuterVolumeSpecName: "kube-api-access-bvfmc") pod "c32abb9f-648f-46a9-88b9-ea72862657ba" (UID: "c32abb9f-648f-46a9-88b9-ea72862657ba"). InnerVolumeSpecName "kube-api-access-bvfmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:51:08.347323 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.347218 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-kube-api-access-pz77m" (OuterVolumeSpecName: "kube-api-access-pz77m") pod "3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" (UID: "3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a"). InnerVolumeSpecName "kube-api-access-pz77m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:51:08.446472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.446423 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:51:08.446472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.446444 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvfmc\" (UniqueName: \"kubernetes.io/projected/c32abb9f-648f-46a9-88b9-ea72862657ba-kube-api-access-bvfmc\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:51:08.446472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.446454 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c32abb9f-648f-46a9-88b9-ea72862657ba-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:51:08.446472 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.446462 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz77m\" (UniqueName: \"kubernetes.io/projected/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a-kube-api-access-pz77m\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:51:08.462609 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:08.462585 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:09.210540 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.210512 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" Sep 10 17:51:09.210991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.210516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl" event={"ID":"c32abb9f-648f-46a9-88b9-ea72862657ba","Type":"ContainerDied","Data":"59ca0762c058eff4c1a6d138153f4cb18fad486a56fef062e53e7ffca645cb02"} Sep 10 17:51:09.210991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.210680 2580 scope.go:117] "RemoveContainer" containerID="0b75e653c3307c73f805d7ba5d2237176b8d2c129fe166d0b00219c00de107db" Sep 10 17:51:09.211991 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.211968 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" Sep 10 17:51:09.212052 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.211987 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q" event={"ID":"3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a","Type":"ContainerDied","Data":"52519de969eaf500ef0749164d9cc1072386ce577cd65520f5276c6f5fa8195d"} Sep 10 17:51:09.222220 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.222026 2580 scope.go:117] "RemoveContainer" containerID="4eb4163cb7d554de1295f7229bb78bfb59b7b5bb5681d47527e4f4cd3609d7fe" Sep 10 17:51:09.239296 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.239273 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q"] Sep 10 17:51:09.244160 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.244137 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q"] Sep 10 17:51:09.255137 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.255114 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl"] Sep 10 17:51:09.264833 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.264815 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl"] Sep 10 17:51:09.431348 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.431326 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" path="/var/lib/kubelet/pods/3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a/volumes" Sep 10 17:51:09.431735 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:09.431718 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c32abb9f-648f-46a9-88b9-ea72862657ba" path="/var/lib/kubelet/pods/c32abb9f-648f-46a9-88b9-ea72862657ba/volumes" Sep 10 17:51:13.490818 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:13.490784 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:20.466001 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:20.465961 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:50.237428 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:50.237393 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:50.507261 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:50.507187 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:53.692418 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:53.692390 2580 scope.go:117] "RemoveContainer" containerID="31f77d2434e17b5eadc0f0d9a23c86b09ea743f7b2f24c2cf77fbb611e8e1ab6" Sep 10 17:51:53.700715 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:53.700696 2580 scope.go:117] "RemoveContainer" containerID="d99ad07a1e78c3bfaff91ca004de0808338b1a747b3b7d783523e5b926167c6e" Sep 10 17:51:56.098706 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:51:56.098670 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:06.624187 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:06.624153 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:08.766070 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:08.766034 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:27.583747 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:27.583659 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:27.683685 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:27.683630 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:27.846215 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:27.846139 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn"] Sep 10 17:52:27.846378 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:27.846341 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" containerID="cri-o://d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a" gracePeriod=30 Sep 10 17:52:27.864875 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:27.864846 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:28.434536 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:28.434496 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:28.693510 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:28.693402 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:28.794350 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:28.794313 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:33.102482 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.102459 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:52:33.173783 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173722 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istiod-ca-cert\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.173783 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173773 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-podinfo\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.173945 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173796 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-credential-socket\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.173945 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173817 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-data\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.173945 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173839 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-token\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.173945 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173854 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-certs\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.173945 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173921 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-envoy\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.174193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173945 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bsqk\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-kube-api-access-9bsqk\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.174193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.173974 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-socket\") pod \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\" (UID: \"ca0c8afa-3fcc-4deb-a137-a19b41f464a6\") " Sep 10 17:52:33.174193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174070 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:52:33.174193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174157 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:52:33.174193 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174185 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:52:33.174397 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174175 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:52:33.174397 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174273 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:52:33.174397 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174357 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.174397 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174377 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.174397 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174392 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.174570 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.174404 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.176000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.175969 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:52:33.176105 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.175999 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:52:33.176309 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.176291 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-kube-api-access-9bsqk" (OuterVolumeSpecName: "kube-api-access-9bsqk") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "kube-api-access-9bsqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:52:33.176479 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.176462 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca0c8afa-3fcc-4deb-a137-a19b41f464a6" (UID: "ca0c8afa-3fcc-4deb-a137-a19b41f464a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:52:33.275364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.275342 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.275364 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.275361 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bsqk\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-kube-api-access-9bsqk\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.275486 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.275370 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.275486 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.275379 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.275486 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.275387 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0c8afa-3fcc-4deb-a137-a19b41f464a6-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:33.655611 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.655584 2580 generic.go:356] "Generic (PLEG): container finished" podID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerID="d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a" exitCode=0 Sep 10 17:52:33.655723 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.655626 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" Sep 10 17:52:33.655723 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.655671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" event={"ID":"ca0c8afa-3fcc-4deb-a137-a19b41f464a6","Type":"ContainerDied","Data":"d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a"} Sep 10 17:52:33.655723 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.655716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn" event={"ID":"ca0c8afa-3fcc-4deb-a137-a19b41f464a6","Type":"ContainerDied","Data":"fb083f6397ed35a4e81f182e5263d50f3220ee15d0160ab58e405b37858301f6"} Sep 10 17:52:33.655857 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.655739 2580 scope.go:117] "RemoveContainer" containerID="d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a" Sep 10 17:52:33.664621 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.664606 2580 scope.go:117] "RemoveContainer" containerID="9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22" Sep 10 17:52:33.672629 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.672614 2580 scope.go:117] "RemoveContainer" containerID="d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a" Sep 10 17:52:33.672908 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:52:33.672889 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a\": container with ID starting with d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a not found: ID does not exist" containerID="d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a" Sep 10 17:52:33.672975 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.672915 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a"} err="failed to get container status \"d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a\": rpc error: code = NotFound desc = could not find container \"d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a\": container with ID starting with d279a2beb95d77418a22c7ab2218af8220ee9d07d665726f474a7e361b7e098a not found: ID does not exist" Sep 10 17:52:33.672975 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.672933 2580 scope.go:117] "RemoveContainer" containerID="9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22" Sep 10 17:52:33.673181 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:52:33.673163 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22\": container with ID starting with 9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22 not found: ID does not exist" containerID="9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22" Sep 10 17:52:33.673217 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.673185 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22"} err="failed to get container status \"9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22\": rpc error: code = NotFound desc = could not find container \"9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22\": container with ID starting with 9d029ec3ea59591ecf86b3349149a36ff1fe0df13c1ac6cc94b8c66ac668fd22 not found: ID does not exist" Sep 10 17:52:33.673926 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.673908 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn"] Sep 10 17:52:33.677886 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:33.677865 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn"] Sep 10 17:52:35.336842 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:35.336811 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:35.432128 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:35.432099 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" path="/var/lib/kubelet/pods/ca0c8afa-3fcc-4deb-a137-a19b41f464a6/volumes" Sep 10 17:52:38.439009 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:38.438954 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:39.053298 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:39.053265 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:39.134132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:39.134085 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:39.205827 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:39.205796 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:39.284882 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:39.284854 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:39.345454 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:39.345378 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:39.652657 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:39.652570 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:45.983577 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:45.983547 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:46.131578 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:46.131550 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:46.280598 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:46.280524 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:46.746257 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:46.746221 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:46.996228 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:46.996198 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:57.166985 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.166945 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:57.198412 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.198380 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc"] Sep 10 17:52:57.198725 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.198694 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" podUID="43530064-f023-4679-8224-0e8fb5a575b1" containerName="payload-processing" containerID="cri-o://834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d" gracePeriod=30 Sep 10 17:52:57.205731 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.205707 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg"] Sep 10 17:52:57.206172 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.206126 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" podUID="d685381e-76ac-4c85-9f47-82649554b441" containerName="payload-pre-processing" containerID="cri-o://d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078" gracePeriod=30 Sep 10 17:52:57.263784 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.263756 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:57.362473 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.362385 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:57.462906 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.462873 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:57.476903 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.476881 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:52:57.479929 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.479913 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:52:57.562763 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.562734 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76dvq\" (UniqueName: \"kubernetes.io/projected/43530064-f023-4679-8224-0e8fb5a575b1-kube-api-access-76dvq\") pod \"43530064-f023-4679-8224-0e8fb5a575b1\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " Sep 10 17:52:57.562927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.562804 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hzn7\" (UniqueName: \"kubernetes.io/projected/d685381e-76ac-4c85-9f47-82649554b441-kube-api-access-2hzn7\") pod \"d685381e-76ac-4c85-9f47-82649554b441\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " Sep 10 17:52:57.562927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.562872 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43530064-f023-4679-8224-0e8fb5a575b1-plugins-config-volume\") pod \"43530064-f023-4679-8224-0e8fb5a575b1\" (UID: \"43530064-f023-4679-8224-0e8fb5a575b1\") " Sep 10 17:52:57.563056 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.562926 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d685381e-76ac-4c85-9f47-82649554b441-plugins-config-volume\") pod \"d685381e-76ac-4c85-9f47-82649554b441\" (UID: \"d685381e-76ac-4c85-9f47-82649554b441\") " Sep 10 17:52:57.563265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.563236 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43530064-f023-4679-8224-0e8fb5a575b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "43530064-f023-4679-8224-0e8fb5a575b1" (UID: "43530064-f023-4679-8224-0e8fb5a575b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:52:57.563396 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.563326 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d685381e-76ac-4c85-9f47-82649554b441-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d685381e-76ac-4c85-9f47-82649554b441" (UID: "d685381e-76ac-4c85-9f47-82649554b441"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:52:57.565046 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.565019 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d685381e-76ac-4c85-9f47-82649554b441-kube-api-access-2hzn7" (OuterVolumeSpecName: "kube-api-access-2hzn7") pod "d685381e-76ac-4c85-9f47-82649554b441" (UID: "d685381e-76ac-4c85-9f47-82649554b441"). InnerVolumeSpecName "kube-api-access-2hzn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:52:57.565174 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.565073 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43530064-f023-4679-8224-0e8fb5a575b1-kube-api-access-76dvq" (OuterVolumeSpecName: "kube-api-access-76dvq") pod "43530064-f023-4679-8224-0e8fb5a575b1" (UID: "43530064-f023-4679-8224-0e8fb5a575b1"). InnerVolumeSpecName "kube-api-access-76dvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:52:57.664254 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.664230 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d685381e-76ac-4c85-9f47-82649554b441-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:57.664254 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.664252 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76dvq\" (UniqueName: \"kubernetes.io/projected/43530064-f023-4679-8224-0e8fb5a575b1-kube-api-access-76dvq\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:57.664409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.664261 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hzn7\" (UniqueName: \"kubernetes.io/projected/d685381e-76ac-4c85-9f47-82649554b441-kube-api-access-2hzn7\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:57.664409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.664269 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43530064-f023-4679-8224-0e8fb5a575b1-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:52:57.761703 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.761627 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:57.786095 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.786073 2580 generic.go:356] "Generic (PLEG): container finished" podID="43530064-f023-4679-8224-0e8fb5a575b1" containerID="834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d" exitCode=0 Sep 10 17:52:57.786191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.786114 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" Sep 10 17:52:57.786191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.786154 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" event={"ID":"43530064-f023-4679-8224-0e8fb5a575b1","Type":"ContainerDied","Data":"834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d"} Sep 10 17:52:57.786276 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.786204 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc" event={"ID":"43530064-f023-4679-8224-0e8fb5a575b1","Type":"ContainerDied","Data":"f6e77d4d155226dc4cf8899ec1e6563a49f81981f3d96838b1f80fb3247eaeac"} Sep 10 17:52:57.786276 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.786230 2580 scope.go:117] "RemoveContainer" containerID="834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d" Sep 10 17:52:57.787805 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.787780 2580 generic.go:356] "Generic (PLEG): container finished" podID="d685381e-76ac-4c85-9f47-82649554b441" containerID="d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078" exitCode=0 Sep 10 17:52:57.787911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.787819 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" Sep 10 17:52:57.787911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.787861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" event={"ID":"d685381e-76ac-4c85-9f47-82649554b441","Type":"ContainerDied","Data":"d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078"} Sep 10 17:52:57.787911 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.787892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg" event={"ID":"d685381e-76ac-4c85-9f47-82649554b441","Type":"ContainerDied","Data":"7b21fac12c8286707ecdd1d114d0492557c0f01632f2346035a8e28e44880b97"} Sep 10 17:52:57.796114 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.796092 2580 scope.go:117] "RemoveContainer" containerID="834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d" Sep 10 17:52:57.796432 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:52:57.796402 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d\": container with ID starting with 834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d not found: ID does not exist" containerID="834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d" Sep 10 17:52:57.796501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.796438 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d"} err="failed to get container status \"834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d\": rpc error: code = NotFound desc = could not find container \"834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d\": container with ID starting with 834f3c320c53a5afc8ad96298f01e56de1e15ea082a8fdb2dcb12eff765b7e4d not found: ID does not exist" Sep 10 17:52:57.796501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.796454 2580 scope.go:117] "RemoveContainer" containerID="d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078" Sep 10 17:52:57.804555 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.804538 2580 scope.go:117] "RemoveContainer" containerID="d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078" Sep 10 17:52:57.804840 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:52:57.804821 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078\": container with ID starting with d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078 not found: ID does not exist" containerID="d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078" Sep 10 17:52:57.804897 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.804846 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078"} err="failed to get container status \"d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078\": rpc error: code = NotFound desc = could not find container \"d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078\": container with ID starting with d9c4a7db5fd077eec1e6eb623e23849723fac871d09698b82f805a94c020e078 not found: ID does not exist" Sep 10 17:52:57.809073 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.809054 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc"] Sep 10 17:52:57.812930 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.812912 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc"] Sep 10 17:52:57.823271 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.823249 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg"] Sep 10 17:52:57.828536 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:57.828518 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg"] Sep 10 17:52:59.431539 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:59.431504 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43530064-f023-4679-8224-0e8fb5a575b1" path="/var/lib/kubelet/pods/43530064-f023-4679-8224-0e8fb5a575b1/volumes" Sep 10 17:52:59.431976 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:52:59.431865 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d685381e-76ac-4c85-9f47-82649554b441" path="/var/lib/kubelet/pods/d685381e-76ac-4c85-9f47-82649554b441/volumes" Sep 10 17:53:04.373679 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:04.373632 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:04.456178 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:04.456150 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:04.638219 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:04.638145 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc"] Sep 10 17:53:04.638369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:04.638351 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" containerID="cri-o://bed4259b72d246226ce32d611a6ad9aaf5e7c17b232a8fc0f6d1970636ae24b5" gracePeriod=30 Sep 10 17:53:04.661663 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:04.661598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:05.127030 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:05.127003 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:09.865737 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:09.865703 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerID="bed4259b72d246226ce32d611a6ad9aaf5e7c17b232a8fc0f6d1970636ae24b5" exitCode=0 Sep 10 17:53:09.866108 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:09.865788 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" event={"ID":"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0","Type":"ContainerDied","Data":"bed4259b72d246226ce32d611a6ad9aaf5e7c17b232a8fc0f6d1970636ae24b5"} Sep 10 17:53:09.866108 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:09.865860 2580 scope.go:117] "RemoveContainer" containerID="f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da" Sep 10 17:53:09.888023 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:53:09.888003 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da\": container with ID starting with f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da not found: ID does not exist" containerID="f205b2c11aa2df5929b633b540624c132c09fbd7610b19596488c1063f9a35da" Sep 10 17:53:09.891534 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:09.891517 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:53:10.065407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065373 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-podinfo\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065407 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065415 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-socket\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065441 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-credential-socket\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065458 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-certs\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065476 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istiod-ca-cert\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065491 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-data\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065537 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-envoy\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065555 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp9ds\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-kube-api-access-tp9ds\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065574 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-token\") pod \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\" (UID: \"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0\") " Sep 10 17:53:10.065987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065734 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:53:10.065987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065717 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:53:10.065987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065772 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:53:10.065987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065874 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.065987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065876 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:53:10.065987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065887 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-credential-socket\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.065987 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.065927 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-workload-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.066509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.066145 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:53:10.067748 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.067725 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-kube-api-access-tp9ds" (OuterVolumeSpecName: "kube-api-access-tp9ds") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "kube-api-access-tp9ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:53:10.067839 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.067772 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 17:53:10.068152 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.068133 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:53:10.068216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.068148 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" (UID: "2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:53:10.167060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.167039 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-podinfo\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.167060 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.167059 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istiod-ca-cert\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.167184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.167068 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-data\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.167184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.167076 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-envoy\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.167184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.167084 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp9ds\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-kube-api-access-tp9ds\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.167184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.167091 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0-istio-token\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:10.872434 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.872407 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" Sep 10 17:53:10.872843 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.872442 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc" event={"ID":"2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0","Type":"ContainerDied","Data":"5e09d9cac6a65d1b5456380ac53f850093b33533d4796975ec19c0569aa34d32"} Sep 10 17:53:10.872843 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.872495 2580 scope.go:117] "RemoveContainer" containerID="bed4259b72d246226ce32d611a6ad9aaf5e7c17b232a8fc0f6d1970636ae24b5" Sep 10 17:53:10.894444 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.894420 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc"] Sep 10 17:53:10.898593 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:10.898567 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc"] Sep 10 17:53:11.432265 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:11.432242 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" path="/var/lib/kubelet/pods/2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0/volumes" Sep 10 17:53:15.613448 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.613401 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:15.626409 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.626377 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj"] Sep 10 17:53:15.626677 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.626626 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" podUID="a6696ec4-420e-49ec-85f8-6e528690f7b8" containerName="payload-processing" containerID="cri-o://88c90c397d593c5180e6dfda6092a3183619b11c46ab6ef2867eef1d88907fc4" gracePeriod=30 Sep 10 17:53:15.634519 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.634490 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw"] Sep 10 17:53:15.634791 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.634748 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" podUID="3b9035cd-660a-4f00-a4cd-f1e00ec6b199" containerName="payload-pre-processing" containerID="cri-o://3059375cbaa6e98d99d35bf8da04ef8e086473a9f2534a99e2e365464b350427" gracePeriod=30 Sep 10 17:53:15.713540 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.713505 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:15.807191 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.807160 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:15.883705 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.883677 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:15.900369 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.900340 2580 generic.go:356] "Generic (PLEG): container finished" podID="a6696ec4-420e-49ec-85f8-6e528690f7b8" containerID="88c90c397d593c5180e6dfda6092a3183619b11c46ab6ef2867eef1d88907fc4" exitCode=0 Sep 10 17:53:15.900457 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.900389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" event={"ID":"a6696ec4-420e-49ec-85f8-6e528690f7b8","Type":"ContainerDied","Data":"88c90c397d593c5180e6dfda6092a3183619b11c46ab6ef2867eef1d88907fc4"} Sep 10 17:53:15.900509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.900454 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" event={"ID":"a6696ec4-420e-49ec-85f8-6e528690f7b8","Type":"ContainerDied","Data":"b3ff902f9bae8e48969c416d5654fd29cfab27926d2988e0c275ab03d5676539"} Sep 10 17:53:15.900509 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.900479 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3ff902f9bae8e48969c416d5654fd29cfab27926d2988e0c275ab03d5676539" Sep 10 17:53:15.901816 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.901797 2580 generic.go:356] "Generic (PLEG): container finished" podID="3b9035cd-660a-4f00-a4cd-f1e00ec6b199" containerID="3059375cbaa6e98d99d35bf8da04ef8e086473a9f2534a99e2e365464b350427" exitCode=0 Sep 10 17:53:15.901904 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.901849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" event={"ID":"3b9035cd-660a-4f00-a4cd-f1e00ec6b199","Type":"ContainerDied","Data":"3059375cbaa6e98d99d35bf8da04ef8e086473a9f2534a99e2e365464b350427"} Sep 10 17:53:15.901904 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.901877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" event={"ID":"3b9035cd-660a-4f00-a4cd-f1e00ec6b199","Type":"ContainerDied","Data":"49ff5a1c8bfe40a097c41eadc33abea2a77150baaa76a868ac633f7389047085"} Sep 10 17:53:15.901904 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.901892 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49ff5a1c8bfe40a097c41eadc33abea2a77150baaa76a868ac633f7389047085" Sep 10 17:53:15.910137 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.910114 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:53:15.913179 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:15.913160 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:53:16.007495 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.007461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5h7m\" (UniqueName: \"kubernetes.io/projected/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-kube-api-access-n5h7m\") pod \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " Sep 10 17:53:16.007718 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.007509 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-plugins-config-volume\") pod \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\" (UID: \"3b9035cd-660a-4f00-a4cd-f1e00ec6b199\") " Sep 10 17:53:16.007718 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.007584 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6c4p\" (UniqueName: \"kubernetes.io/projected/a6696ec4-420e-49ec-85f8-6e528690f7b8-kube-api-access-t6c4p\") pod \"a6696ec4-420e-49ec-85f8-6e528690f7b8\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " Sep 10 17:53:16.007718 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.007627 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6696ec4-420e-49ec-85f8-6e528690f7b8-plugins-config-volume\") pod \"a6696ec4-420e-49ec-85f8-6e528690f7b8\" (UID: \"a6696ec4-420e-49ec-85f8-6e528690f7b8\") " Sep 10 17:53:16.007959 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.007933 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b9035cd-660a-4f00-a4cd-f1e00ec6b199" (UID: "3b9035cd-660a-4f00-a4cd-f1e00ec6b199"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:53:16.008018 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.007972 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6696ec4-420e-49ec-85f8-6e528690f7b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6696ec4-420e-49ec-85f8-6e528690f7b8" (UID: "a6696ec4-420e-49ec-85f8-6e528690f7b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:53:16.009698 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.009676 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6696ec4-420e-49ec-85f8-6e528690f7b8-kube-api-access-t6c4p" (OuterVolumeSpecName: "kube-api-access-t6c4p") pod "a6696ec4-420e-49ec-85f8-6e528690f7b8" (UID: "a6696ec4-420e-49ec-85f8-6e528690f7b8"). InnerVolumeSpecName "kube-api-access-t6c4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:53:16.009777 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.009697 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-kube-api-access-n5h7m" (OuterVolumeSpecName: "kube-api-access-n5h7m") pod "3b9035cd-660a-4f00-a4cd-f1e00ec6b199" (UID: "3b9035cd-660a-4f00-a4cd-f1e00ec6b199"). InnerVolumeSpecName "kube-api-access-n5h7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:53:16.108293 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.108262 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5h7m\" (UniqueName: \"kubernetes.io/projected/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-kube-api-access-n5h7m\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:16.108293 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.108287 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9035cd-660a-4f00-a4cd-f1e00ec6b199-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:16.108428 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.108301 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6c4p\" (UniqueName: \"kubernetes.io/projected/a6696ec4-420e-49ec-85f8-6e528690f7b8-kube-api-access-t6c4p\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:16.108428 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.108313 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6696ec4-420e-49ec-85f8-6e528690f7b8-plugins-config-volume\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:53:16.191146 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.191092 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:16.907311 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.907263 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj" Sep 10 17:53:16.907596 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.907265 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw" Sep 10 17:53:16.933813 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.933788 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj"] Sep 10 17:53:16.938866 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.938842 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj"] Sep 10 17:53:16.952928 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.952906 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw"] Sep 10 17:53:16.956853 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:16.956834 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw"] Sep 10 17:53:17.431286 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:17.431261 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9035cd-660a-4f00-a4cd-f1e00ec6b199" path="/var/lib/kubelet/pods/3b9035cd-660a-4f00-a4cd-f1e00ec6b199/volumes" Sep 10 17:53:17.431582 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:17.431569 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6696ec4-420e-49ec-85f8-6e528690f7b8" path="/var/lib/kubelet/pods/a6696ec4-420e-49ec-85f8-6e528690f7b8/volumes" Sep 10 17:53:22.347993 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:22.347968 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:22.447171 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:22.447131 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:22.608411 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:22.608314 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:53.745247 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:53.745217 2580 scope.go:117] "RemoveContainer" containerID="3059375cbaa6e98d99d35bf8da04ef8e086473a9f2534a99e2e365464b350427" Sep 10 17:53:53.753443 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:53.753424 2580 scope.go:117] "RemoveContainer" containerID="88c90c397d593c5180e6dfda6092a3183619b11c46ab6ef2867eef1d88907fc4" Sep 10 17:53:56.656989 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:53:56.656951 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:54:46.066216 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:54:46.066178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:54:48.319034 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:54:48.318988 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:54:49.837501 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:54:49.837466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:54:53.787822 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:54:53.787793 2580 scope.go:117] "RemoveContainer" containerID="1ae199fc89591e1c77290f576ecd9161e8d758fc691ff97d70ba22587b53a6ee" Sep 10 17:57:40.978515 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:57:40.978467 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:46.630155 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:57:46.630117 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:01.998378 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:58:01.998335 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:32.879165 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:58:32.879131 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:42.264210 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:58:42.264176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:43.236927 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:58:43.236892 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:51.598508 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:58:51.598476 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:51.699537 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:58:51.699453 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:01.201587 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201551 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84847f94bc-pn58n"] Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201886 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d685381e-76ac-4c85-9f47-82649554b441" containerName="payload-pre-processing" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201898 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d685381e-76ac-4c85-9f47-82649554b441" containerName="payload-pre-processing" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201909 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9035cd-660a-4f00-a4cd-f1e00ec6b199" containerName="payload-pre-processing" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201914 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9035cd-660a-4f00-a4cd-f1e00ec6b199" containerName="payload-pre-processing" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201920 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" containerName="payload-pre-processing" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201926 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" containerName="payload-pre-processing" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201933 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201939 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201948 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201952 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" Sep 10 17:59:01.201955 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201961 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6696ec4-420e-49ec-85f8-6e528690f7b8" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201966 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6696ec4-420e-49ec-85f8-6e528690f7b8" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201972 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43530064-f023-4679-8224-0e8fb5a575b1" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201977 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="43530064-f023-4679-8224-0e8fb5a575b1" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201983 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c32abb9f-648f-46a9-88b9-ea72862657ba" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201988 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c32abb9f-648f-46a9-88b9-ea72862657ba" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.201997 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cb9969-3a9b-49a4-9707-dfc6207a7fc3" containerName="payload-pre-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202010 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cb9969-3a9b-49a4-9707-dfc6207a7fc3" containerName="payload-pre-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202085 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="43530064-f023-4679-8224-0e8fb5a575b1" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202096 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9035cd-660a-4f00-a4cd-f1e00ec6b199" containerName="payload-pre-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202101 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6696ec4-420e-49ec-85f8-6e528690f7b8" containerName="payload-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202107 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc86c08-f1e3-42e4-94b9-85df4c2e4a4a" containerName="payload-pre-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202114 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="44cb9969-3a9b-49a4-9707-dfc6207a7fc3" containerName="payload-pre-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202119 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202124 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202129 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d685381e-76ac-4c85-9f47-82649554b441" containerName="payload-pre-processing" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202133 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202138 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" Sep 10 17:59:01.202287 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.202142 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c32abb9f-648f-46a9-88b9-ea72862657ba" containerName="payload-processing" Sep 10 17:59:01.205013 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.204996 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.207868 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.207843 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x68r5\"" Sep 10 17:59:01.207989 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.207866 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 17:59:01.207989 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.207846 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 10 17:59:01.207989 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.207866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 10 17:59:01.208130 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.207844 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 17:59:01.218049 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.218027 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84847f94bc-pn58n"] Sep 10 17:59:01.249998 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.249979 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-maas-api-tls\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.250106 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.250042 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8904f935-0b96-4b0c-8b88-d53c19a14176-openshift-service-ca\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.250106 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.250081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554zn\" (UniqueName: \"kubernetes.io/projected/8904f935-0b96-4b0c-8b88-d53c19a14176-kube-api-access-554zn\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.250106 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.250103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-metrics-certs\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.351199 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.351177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8904f935-0b96-4b0c-8b88-d53c19a14176-openshift-service-ca\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.351295 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.351214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554zn\" (UniqueName: \"kubernetes.io/projected/8904f935-0b96-4b0c-8b88-d53c19a14176-kube-api-access-554zn\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.351295 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.351238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-metrics-certs\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.351295 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.351259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-maas-api-tls\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.351913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.351894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8904f935-0b96-4b0c-8b88-d53c19a14176-openshift-service-ca\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.353730 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.353705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-maas-api-tls\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.353800 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.353760 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-metrics-certs\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.359586 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.359567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-554zn\" (UniqueName: \"kubernetes.io/projected/8904f935-0b96-4b0c-8b88-d53c19a14176-kube-api-access-554zn\") pod \"maas-api-84847f94bc-pn58n\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.515661 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.515571 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:01.787184 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.787159 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84847f94bc-pn58n"] Sep 10 17:59:01.789273 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:59:01.789241 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8904f935_0b96_4b0c_8b88_d53c19a14176.slice/crio-1d6e774f050bf7582bba4b67ae9a28677982902ecb94f1a6204543804e56af25 WatchSource:0}: Error finding container 1d6e774f050bf7582bba4b67ae9a28677982902ecb94f1a6204543804e56af25: Status 404 returned error can't find the container with id 1d6e774f050bf7582bba4b67ae9a28677982902ecb94f1a6204543804e56af25 Sep 10 17:59:01.790522 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:01.790505 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:59:02.717132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:02.717092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" event={"ID":"8904f935-0b96-4b0c-8b88-d53c19a14176","Type":"ContainerStarted","Data":"1d6e774f050bf7582bba4b67ae9a28677982902ecb94f1a6204543804e56af25"} Sep 10 17:59:04.731203 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:04.731169 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" event={"ID":"8904f935-0b96-4b0c-8b88-d53c19a14176","Type":"ContainerStarted","Data":"608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01"} Sep 10 17:59:04.731579 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:04.731320 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:04.748912 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:04.748867 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" podStartSLOduration=1.523933928 podStartE2EDuration="3.748854243s" totalImagesPullingTime="2.224920315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:04.746767409 +0000 UTC m=+2111.766694573" watchObservedRunningTime="2026-09-10 17:59:04.748854243 +0000 UTC m=+2111.768781393" Sep 10 17:59:08.412922 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.412887 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84847f94bc-pn58n"] Sep 10 17:59:08.413384 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.413047 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" podUID="8904f935-0b96-4b0c-8b88-d53c19a14176" containerName="maas-api" containerID="cri-o://608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01" gracePeriod=30 Sep 10 17:59:08.443268 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.443239 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c94d45875-779pn"] Sep 10 17:59:08.443621 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.443605 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" Sep 10 17:59:08.443738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.443630 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1596fc-5a4a-4d30-b4c4-16fa0c47dff0" containerName="istio-proxy" Sep 10 17:59:08.443738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.443673 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" Sep 10 17:59:08.443738 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.443682 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0c8afa-3fcc-4deb-a137-a19b41f464a6" containerName="istio-proxy" Sep 10 17:59:08.446654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.446622 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.457648 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.457621 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c94d45875-779pn"] Sep 10 17:59:08.509684 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.509655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnl7m\" (UniqueName: \"kubernetes.io/projected/e41a89d0-dcdf-4cfd-984f-3e22b241a816-kube-api-access-gnl7m\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.509798 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.509778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e41a89d0-dcdf-4cfd-984f-3e22b241a816-openshift-service-ca\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.509888 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.509870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41a89d0-dcdf-4cfd-984f-3e22b241a816-metrics-certs\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.509949 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.509927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e41a89d0-dcdf-4cfd-984f-3e22b241a816-maas-api-tls\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.611414 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.611383 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e41a89d0-dcdf-4cfd-984f-3e22b241a816-openshift-service-ca\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.611563 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.611445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41a89d0-dcdf-4cfd-984f-3e22b241a816-metrics-certs\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.611563 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.611473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e41a89d0-dcdf-4cfd-984f-3e22b241a816-maas-api-tls\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.611563 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.611510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnl7m\" (UniqueName: \"kubernetes.io/projected/e41a89d0-dcdf-4cfd-984f-3e22b241a816-kube-api-access-gnl7m\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.612176 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.612149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e41a89d0-dcdf-4cfd-984f-3e22b241a816-openshift-service-ca\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.614028 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.614003 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e41a89d0-dcdf-4cfd-984f-3e22b241a816-maas-api-tls\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.614167 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.614149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41a89d0-dcdf-4cfd-984f-3e22b241a816-metrics-certs\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.620018 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.619995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnl7m\" (UniqueName: \"kubernetes.io/projected/e41a89d0-dcdf-4cfd-984f-3e22b241a816-kube-api-access-gnl7m\") pod \"maas-api-c94d45875-779pn\" (UID: \"e41a89d0-dcdf-4cfd-984f-3e22b241a816\") " pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.653168 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.653146 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:08.712417 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.712395 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-554zn\" (UniqueName: \"kubernetes.io/projected/8904f935-0b96-4b0c-8b88-d53c19a14176-kube-api-access-554zn\") pod \"8904f935-0b96-4b0c-8b88-d53c19a14176\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " Sep 10 17:59:08.712521 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.712430 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8904f935-0b96-4b0c-8b88-d53c19a14176-openshift-service-ca\") pod \"8904f935-0b96-4b0c-8b88-d53c19a14176\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " Sep 10 17:59:08.712521 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.712472 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-maas-api-tls\") pod \"8904f935-0b96-4b0c-8b88-d53c19a14176\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " Sep 10 17:59:08.712654 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.712588 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-metrics-certs\") pod \"8904f935-0b96-4b0c-8b88-d53c19a14176\" (UID: \"8904f935-0b96-4b0c-8b88-d53c19a14176\") " Sep 10 17:59:08.712813 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.712792 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8904f935-0b96-4b0c-8b88-d53c19a14176-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8904f935-0b96-4b0c-8b88-d53c19a14176" (UID: "8904f935-0b96-4b0c-8b88-d53c19a14176"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:59:08.712918 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.712895 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8904f935-0b96-4b0c-8b88-d53c19a14176-openshift-service-ca\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:59:08.714560 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.714533 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8904f935-0b96-4b0c-8b88-d53c19a14176" (UID: "8904f935-0b96-4b0c-8b88-d53c19a14176"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:59:08.714666 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.714585 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8904f935-0b96-4b0c-8b88-d53c19a14176-kube-api-access-554zn" (OuterVolumeSpecName: "kube-api-access-554zn") pod "8904f935-0b96-4b0c-8b88-d53c19a14176" (UID: "8904f935-0b96-4b0c-8b88-d53c19a14176"). InnerVolumeSpecName "kube-api-access-554zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:59:08.714666 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.714590 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8904f935-0b96-4b0c-8b88-d53c19a14176" (UID: "8904f935-0b96-4b0c-8b88-d53c19a14176"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:59:08.755556 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.755530 2580 generic.go:356] "Generic (PLEG): container finished" podID="8904f935-0b96-4b0c-8b88-d53c19a14176" containerID="608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01" exitCode=0 Sep 10 17:59:08.755688 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.755567 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" Sep 10 17:59:08.755688 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.755604 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" event={"ID":"8904f935-0b96-4b0c-8b88-d53c19a14176","Type":"ContainerDied","Data":"608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01"} Sep 10 17:59:08.755810 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.755677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84847f94bc-pn58n" event={"ID":"8904f935-0b96-4b0c-8b88-d53c19a14176","Type":"ContainerDied","Data":"1d6e774f050bf7582bba4b67ae9a28677982902ecb94f1a6204543804e56af25"} Sep 10 17:59:08.755810 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.755723 2580 scope.go:117] "RemoveContainer" containerID="608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01" Sep 10 17:59:08.764464 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.764445 2580 scope.go:117] "RemoveContainer" containerID="608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01" Sep 10 17:59:08.764759 ip-10-0-131-138 kubenswrapper[2580]: E0910 17:59:08.764743 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01\": container with ID starting with 608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01 not found: ID does not exist" containerID="608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01" Sep 10 17:59:08.764819 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.764764 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01"} err="failed to get container status \"608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01\": rpc error: code = NotFound desc = could not find container \"608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01\": container with ID starting with 608f900bc983082939464e7bb6b3bb48efc20d970a724494a16fe61a64678f01 not found: ID does not exist" Sep 10 17:59:08.776221 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.776201 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84847f94bc-pn58n"] Sep 10 17:59:08.781405 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.781382 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84847f94bc-pn58n"] Sep 10 17:59:08.806624 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.806600 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:08.813961 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.813939 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-metrics-certs\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:59:08.814059 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.813966 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-554zn\" (UniqueName: \"kubernetes.io/projected/8904f935-0b96-4b0c-8b88-d53c19a14176-kube-api-access-554zn\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:59:08.814059 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:08.813981 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8904f935-0b96-4b0c-8b88-d53c19a14176-maas-api-tls\") on node \"ip-10-0-131-138.ec2.internal\" DevicePath \"\"" Sep 10 17:59:09.077132 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:09.077110 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c94d45875-779pn"] Sep 10 17:59:09.078565 ip-10-0-131-138 kubenswrapper[2580]: W0910 17:59:09.078541 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41a89d0_dcdf_4cfd_984f_3e22b241a816.slice/crio-adabe2685d010219de89186659ca45b2a7ef09106ea51f879c86215f4baccf70 WatchSource:0}: Error finding container adabe2685d010219de89186659ca45b2a7ef09106ea51f879c86215f4baccf70: Status 404 returned error can't find the container with id adabe2685d010219de89186659ca45b2a7ef09106ea51f879c86215f4baccf70 Sep 10 17:59:09.431486 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:09.431462 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8904f935-0b96-4b0c-8b88-d53c19a14176" path="/var/lib/kubelet/pods/8904f935-0b96-4b0c-8b88-d53c19a14176/volumes" Sep 10 17:59:09.764213 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:09.764174 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" event={"ID":"e41a89d0-dcdf-4cfd-984f-3e22b241a816","Type":"ContainerStarted","Data":"987cf1e39cc4351e9e614a93508ec4dc0766bf90299ca4de8e7cc2dcc4c98dd6"} Sep 10 17:59:09.764375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:09.764242 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:09.764375 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:09.764268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" event={"ID":"e41a89d0-dcdf-4cfd-984f-3e22b241a816","Type":"ContainerStarted","Data":"adabe2685d010219de89186659ca45b2a7ef09106ea51f879c86215f4baccf70"} Sep 10 17:59:09.782045 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:09.781997 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" podStartSLOduration=1.454531494 podStartE2EDuration="1.78198036s" totalImagesPullingTime="327.448866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:09.78042351 +0000 UTC m=+2116.800350671" watchObservedRunningTime="2026-09-10 17:59:09.78198036 +0000 UTC m=+2116.801907512" Sep 10 17:59:15.774368 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:15.774338 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c94d45875-779pn" Sep 10 17:59:37.527952 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:37.527899 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cmmxn_abde387a-641f-4cb4-82be-fd39c68d92ee/manager/0.log" Sep 10 17:59:37.635917 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:37.635891 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6bb7766-62ljl_d7fcd749-5bab-42ea-8200-49868691d0bb/copy-manifests/0.log" Sep 10 17:59:37.645576 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:37.645553 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6bb7766-62ljl_d7fcd749-5bab-42ea-8200-49868691d0bb/manager/0.log" Sep 10 17:59:38.245513 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:38.245493 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c94d45875-779pn_e41a89d0-dcdf-4cfd-984f-3e22b241a816/maas-api/0.log" Sep 10 17:59:40.441210 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:40.441178 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42_d3d38ade-a3d4-4168-b88a-c32bedc4fe78/istio-proxy/0.log" Sep 10 17:59:40.571242 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:40.571208 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d7dqd_e7707128-c45e-4651-8624-670f12ee5796/discovery/0.log" Sep 10 17:59:40.923656 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:40.923581 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nbdb5_28e4666c-2a88-4f4b-b935-a630c4228a26/istio-proxy/1.log" Sep 10 17:59:41.157872 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:41.157846 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2f4pf_3a240dad-cbbd-4e69-a10a-a56bf3221468/payload-processing/0.log" Sep 10 17:59:41.270894 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:41.270874 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d87c44-k7klw_a9758fc6-dc5e-4d88-860b-31572756f191/router/0.log" Sep 10 17:59:42.176043 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:42.176022 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7hf98_a73754fb-ab0d-4210-aecb-89774a24177d/main/0.log" Sep 10 17:59:44.089482 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:44.089448 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:44.189260 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:44.189231 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:47.906614 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:47.906530 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:47.997560 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:47.997515 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:50.923677 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:50.923650 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wbp2m_3b0ca9b3-ec62-46eb-8b4d-90d67ff8afe0/global-pull-secret-syncer/0.log" Sep 10 17:59:50.980659 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:50.980610 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cmr5h_fd1d4809-08c3-4961-91c1-ac91158d616d/konnectivity-agent/0.log" Sep 10 17:59:51.089142 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:51.089122 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-138.ec2.internal_66b6d9c8cad404e073ce8c64fcad27b9/haproxy/0.log" Sep 10 17:59:57.725000 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:57.724964 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-p9qfk_ed305f05-d529-4541-8b6a-99335447658e/cluster-monitoring-operator/0.log" Sep 10 17:59:57.963942 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:57.963916 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-fqmmz_29b9affe-344a-45cd-978a-33946ff8aa80/monitoring-plugin/0.log" Sep 10 17:59:58.001879 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.001824 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nblv_9a3b02bf-c70a-4490-9fd9-674cf55c5f57/node-exporter/0.log" Sep 10 17:59:58.038389 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.038370 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nblv_9a3b02bf-c70a-4490-9fd9-674cf55c5f57/kube-rbac-proxy/0.log" Sep 10 17:59:58.070846 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.070829 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nblv_9a3b02bf-c70a-4490-9fd9-674cf55c5f57/init-textfile/0.log" Sep 10 17:59:58.271286 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.271225 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-tfnzt_134198fc-ea5d-4d91-8af6-1f28186c48a3/kube-rbac-proxy-main/0.log" Sep 10 17:59:58.301783 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.301737 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-tfnzt_134198fc-ea5d-4d91-8af6-1f28186c48a3/kube-rbac-proxy-self/0.log" Sep 10 17:59:58.328400 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.328376 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-tfnzt_134198fc-ea5d-4d91-8af6-1f28186c48a3/openshift-state-metrics/0.log" Sep 10 17:59:58.559910 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.559853 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-nltb4_688121c1-46c4-41e0-a596-1fb4d7cda1c6/prometheus-operator/0.log" Sep 10 17:59:58.577348 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.577327 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-nltb4_688121c1-46c4-41e0-a596-1fb4d7cda1c6/kube-rbac-proxy/0.log" Sep 10 17:59:58.635939 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.635919 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d664986cd-xhb8b_5ae9d0f2-a9f9-4325-b77b-1522163d7caf/telemeter-client/0.log" Sep 10 17:59:58.657913 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.657894 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d664986cd-xhb8b_5ae9d0f2-a9f9-4325-b77b-1522163d7caf/reload/0.log" Sep 10 17:59:58.708314 ip-10-0-131-138 kubenswrapper[2580]: I0910 17:59:58.708297 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d664986cd-xhb8b_5ae9d0f2-a9f9-4325-b77b-1522163d7caf/kube-rbac-proxy/0.log" Sep 10 18:00:00.814609 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.814571 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp"] Sep 10 18:00:00.815057 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.814979 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8904f935-0b96-4b0c-8b88-d53c19a14176" containerName="maas-api" Sep 10 18:00:00.815057 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.814993 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8904f935-0b96-4b0c-8b88-d53c19a14176" containerName="maas-api" Sep 10 18:00:00.815138 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.815067 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8904f935-0b96-4b0c-8b88-d53c19a14176" containerName="maas-api" Sep 10 18:00:00.817068 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.817051 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.819348 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.819330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8jqk\"/\"kube-root-ca.crt\"" Sep 10 18:00:00.819633 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.819612 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8jqk\"/\"openshift-service-ca.crt\"" Sep 10 18:00:00.820034 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.820019 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j8jqk\"/\"default-dockercfg-hcms2\"" Sep 10 18:00:00.828406 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.828384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp"] Sep 10 18:00:00.892124 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.892099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-proc\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.892282 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.892137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-podres\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.892282 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.892231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-lib-modules\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.892282 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.892261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5nwg\" (UniqueName: \"kubernetes.io/projected/c27b8a75-495e-46d1-9963-f9ab1060f8bd-kube-api-access-l5nwg\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.892417 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.892296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-sys\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993346 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-podres\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993467 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-lib-modules\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993467 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5nwg\" (UniqueName: \"kubernetes.io/projected/c27b8a75-495e-46d1-9963-f9ab1060f8bd-kube-api-access-l5nwg\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993467 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-sys\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993467 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-proc\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993631 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993497 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-lib-modules\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993631 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993500 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-podres\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993631 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-proc\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:00.993631 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:00.993527 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c27b8a75-495e-46d1-9963-f9ab1060f8bd-sys\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:01.002246 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:01.002220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5nwg\" (UniqueName: \"kubernetes.io/projected/c27b8a75-495e-46d1-9963-f9ab1060f8bd-kube-api-access-l5nwg\") pod \"perf-node-gather-daemonset-75tkp\" (UID: \"c27b8a75-495e-46d1-9963-f9ab1060f8bd\") " pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:01.127067 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:01.127020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:01.393669 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:01.393619 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp"] Sep 10 18:00:01.395424 ip-10-0-131-138 kubenswrapper[2580]: W0910 18:00:01.395394 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc27b8a75_495e_46d1_9963_f9ab1060f8bd.slice/crio-2403bf3288dd7519b2cd2c1433e3edbc1f90311433363b8aac0c0d6981d2cadc WatchSource:0}: Error finding container 2403bf3288dd7519b2cd2c1433e3edbc1f90311433363b8aac0c0d6981d2cadc: Status 404 returned error can't find the container with id 2403bf3288dd7519b2cd2c1433e3edbc1f90311433363b8aac0c0d6981d2cadc Sep 10 18:00:02.024216 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:02.024184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" event={"ID":"c27b8a75-495e-46d1-9963-f9ab1060f8bd","Type":"ContainerStarted","Data":"ebdcb93f7c853c615b8941ad6688aeb4a8e43f4e2e8ecc9b4cb7d17392389ecb"} Sep 10 18:00:02.024550 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:02.024243 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:02.024550 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:02.024268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" event={"ID":"c27b8a75-495e-46d1-9963-f9ab1060f8bd","Type":"ContainerStarted","Data":"2403bf3288dd7519b2cd2c1433e3edbc1f90311433363b8aac0c0d6981d2cadc"} Sep 10 18:00:02.041600 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:02.041557 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" podStartSLOduration=2.04154265 podStartE2EDuration="2.04154265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:02.040421556 +0000 UTC m=+2169.060348709" watchObservedRunningTime="2026-09-10 18:00:02.04154265 +0000 UTC m=+2169.061469800" Sep 10 18:00:03.434946 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:03.434904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wb4sd_f964bb89-dc3b-41b5-870d-5b45c48e543b/dns/0.log" Sep 10 18:00:03.454436 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:03.454409 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wb4sd_f964bb89-dc3b-41b5-870d-5b45c48e543b/kube-rbac-proxy/0.log" Sep 10 18:00:03.507762 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:03.507741 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bvpp_c93b03a1-a891-40ae-ac9e-b12918218e6b/dns-node-resolver/0.log" Sep 10 18:00:04.065314 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:04.065294 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6847f7bdd8-8trbb_c25f0ce7-f3ab-434b-b5f6-00dc22791142/registry/0.log" Sep 10 18:00:04.080195 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:04.080158 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6847f7bdd8-8trbb_c25f0ce7-f3ab-434b-b5f6-00dc22791142/registry/1.log" Sep 10 18:00:04.127439 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:04.127419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jp7bx_9d251a7f-bcd4-4da3-b8ce-7b0b9a0d3105/node-ca/0.log" Sep 10 18:00:05.077382 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:05.077357 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42_d3d38ade-a3d4-4168-b88a-c32bedc4fe78/istio-proxy/0.log" Sep 10 18:00:05.512713 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:05.512684 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d7dqd_e7707128-c45e-4651-8624-670f12ee5796/discovery/0.log" Sep 10 18:00:05.596466 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:05.596439 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nbdb5_28e4666c-2a88-4f4b-b935-a630c4228a26/istio-proxy/0.log" Sep 10 18:00:05.610850 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:05.610827 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nbdb5_28e4666c-2a88-4f4b-b935-a630c4228a26/istio-proxy/1.log" Sep 10 18:00:05.698796 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:05.698774 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2f4pf_3a240dad-cbbd-4e69-a10a-a56bf3221468/payload-processing/0.log" Sep 10 18:00:05.729967 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:05.729950 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d87c44-k7klw_a9758fc6-dc5e-4d88-860b-31572756f191/router/0.log" Sep 10 18:00:06.683152 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:06.683126 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wsprp_5d97d8ac-90b4-4d8e-b7a3-182f30013876/serve-healthcheck-canary/0.log" Sep 10 18:00:07.158355 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:07.158330 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-xpb6t_abef3868-6891-4c5e-8e7f-15fe407e3688/insights-operator/0.log" Sep 10 18:00:07.161509 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:07.161477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-xpb6t_abef3868-6891-4c5e-8e7f-15fe407e3688/insights-operator/1.log" Sep 10 18:00:07.253570 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:07.253549 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9mv4_39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9/kube-rbac-proxy/0.log" Sep 10 18:00:07.272503 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:07.272484 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9mv4_39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9/exporter/0.log" Sep 10 18:00:07.294327 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:07.294312 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9mv4_39a78ca6-fe3c-4e17-88aa-9ff3cb1319a9/extractor/0.log" Sep 10 18:00:08.038880 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:08.038853 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j8jqk/perf-node-gather-daemonset-75tkp" Sep 10 18:00:10.085924 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:10.085892 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cmmxn_abde387a-641f-4cb4-82be-fd39c68d92ee/manager/0.log" Sep 10 18:00:10.114506 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:10.114477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6bb7766-62ljl_d7fcd749-5bab-42ea-8200-49868691d0bb/manager/0.log" Sep 10 18:00:10.135966 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:10.135947 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6bb7766-62ljl_d7fcd749-5bab-42ea-8200-49868691d0bb/copy-manifests/0.log" Sep 10 18:00:11.306075 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:11.306044 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42_d3d38ade-a3d4-4168-b88a-c32bedc4fe78/istio-proxy/0.log" Sep 10 18:00:11.586973 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:11.586945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86c5cb66bd-jd4vl_ff8e73a5-7be4-4b3c-bf93-c885b89ec452/manager/0.log" Sep 10 18:00:11.719617 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:11.719591 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d7dqd_e7707128-c45e-4651-8624-670f12ee5796/discovery/0.log" Sep 10 18:00:11.774595 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:11.774576 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nbdb5_28e4666c-2a88-4f4b-b935-a630c4228a26/istio-proxy/0.log" Sep 10 18:00:11.789767 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:11.789742 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nbdb5_28e4666c-2a88-4f4b-b935-a630c4228a26/istio-proxy/1.log" Sep 10 18:00:11.857524 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:11.857464 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2f4pf_3a240dad-cbbd-4e69-a10a-a56bf3221468/payload-processing/0.log" Sep 10 18:00:11.885308 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:11.885285 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d87c44-k7klw_a9758fc6-dc5e-4d88-860b-31572756f191/router/0.log" Sep 10 18:00:13.369581 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:13.369551 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42_d3d38ade-a3d4-4168-b88a-c32bedc4fe78/istio-proxy/0.log" Sep 10 18:00:13.808194 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:13.808166 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d7dqd_e7707128-c45e-4651-8624-670f12ee5796/discovery/0.log" Sep 10 18:00:13.873956 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:13.873928 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nbdb5_28e4666c-2a88-4f4b-b935-a630c4228a26/istio-proxy/0.log" Sep 10 18:00:13.888818 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:13.888792 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nbdb5_28e4666c-2a88-4f4b-b935-a630c4228a26/istio-proxy/1.log" Sep 10 18:00:13.961415 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:13.961389 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2f4pf_3a240dad-cbbd-4e69-a10a-a56bf3221468/payload-processing/0.log" Sep 10 18:00:13.979291 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:13.979271 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d87c44-k7klw_a9758fc6-dc5e-4d88-860b-31572756f191/router/0.log" Sep 10 18:00:17.060664 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:17.060610 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-gnh6v_fdfc6c25-6050-4909-bc9f-f493c7f81ff1/kube-storage-version-migrator-operator/1.log" Sep 10 18:00:17.062277 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:17.062249 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-gnh6v_fdfc6c25-6050-4909-bc9f-f493c7f81ff1/kube-storage-version-migrator-operator/0.log" Sep 10 18:00:18.096063 ip-10-0-131-138 kubenswrapper[2580]: I0910 18:00:18.096028 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-294nx_8f35879b-7d56-41ed-b169-88af090de606/kube-multus/0.log"